-- Logs begin at Tue 2022-07-05 12:06:00 UTC, end at Tue 2022-07-05 13:19:04 UTC. -- Jul 05 12:52:19.646005 dv-cinder-797608-48-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 05 12:52:19.657266 dv-cinder-797608-48-iscsi devstack@n-api.service[103664]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 05 12:52:19.657266 dv-cinder-797608-48-iscsi devstack@n-api.service[103664]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 5 12:52:19 2022] *** Jul 05 12:52:19.657266 dv-cinder-797608-48-iscsi devstack@n-api.service[103664]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 05 12:52:19.657266 dv-cinder-797608-48-iscsi devstack@n-api.service[103664]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 05 12:52:19.657266 dv-cinder-797608-48-iscsi devstack@n-api.service[103664]: nodename: dv-cinder-797608-48-iscsi Jul 05 12:52:19.657266 dv-cinder-797608-48-iscsi devstack@n-api.service[103664]: machine: x86_64 Jul 05 12:52:19.657266 dv-cinder-797608-48-iscsi devstack@n-api.service[103664]: clock source: unix Jul 05 12:52:19.657266 dv-cinder-797608-48-iscsi devstack@n-api.service[103664]: pcre jit disabled Jul 05 12:52:19.657266 dv-cinder-797608-48-iscsi devstack@n-api.service[103664]: detected number of CPU cores: 4 Jul 05 12:52:19.657266 dv-cinder-797608-48-iscsi devstack@n-api.service[103664]: current working directory: / Jul 05 12:52:19.657266 dv-cinder-797608-48-iscsi devstack@n-api.service[103664]: detected binary path: /usr/bin/uwsgi-core Jul 05 12:52:19.657266 dv-cinder-797608-48-iscsi devstack@n-api.service[103664]: your processes number limit is 47680 Jul 05 12:52:19.657266 dv-cinder-797608-48-iscsi devstack@n-api.service[103664]: your memory page size is 4096 bytes Jul 05 12:52:19.657266 dv-cinder-797608-48-iscsi devstack@n-api.service[103664]: detected max file descriptor number: 2048 Jul 05 12:52:19.657266 dv-cinder-797608-48-iscsi devstack@n-api.service[103664]: lock engine: pthread robust mutexes Jul 05 12:52:19.657266 dv-cinder-797608-48-iscsi devstack@n-api.service[103664]: thunder lock: enabled Jul 05 12:52:19.657266 dv-cinder-797608-48-iscsi devstack@n-api.service[103664]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 05 12:52:19.657266 dv-cinder-797608-48-iscsi devstack@n-api.service[103664]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 05 12:52:19.700504 dv-cinder-797608-48-iscsi devstack@n-api.service[103664]: Python main interpreter initialized at 0x56247a4c69c0 Jul 05 12:52:19.700504 dv-cinder-797608-48-iscsi devstack@n-api.service[103664]: python threads support enabled Jul 05 12:52:19.700504 dv-cinder-797608-48-iscsi devstack@n-api.service[103664]: your server socket listen backlog is limited to 100 connections Jul 05 12:52:19.700504 dv-cinder-797608-48-iscsi devstack@n-api.service[103664]: your mercy for graceful operations on workers is 90 seconds Jul 05 12:52:19.700867 dv-cinder-797608-48-iscsi devstack@n-api.service[103664]: mapped 403077 bytes (393 KB) for 2 cores Jul 05 12:52:19.700933 dv-cinder-797608-48-iscsi devstack@n-api.service[103664]: *** Operational MODE: preforking *** Jul 05 12:52:19.701187 dv-cinder-797608-48-iscsi devstack@n-api.service[103664]: *** uWSGI is running in multiple interpreter mode *** Jul 05 12:52:19.701187 dv-cinder-797608-48-iscsi devstack@n-api.service[103664]: spawned uWSGI master process (pid: 103664) Jul 05 12:52:19.701381 dv-cinder-797608-48-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 05 12:52:19.701926 dv-cinder-797608-48-iscsi devstack@n-api.service[103664]: spawned uWSGI worker 1 (pid: 103665, cores: 1) Jul 05 12:52:19.702806 dv-cinder-797608-48-iscsi devstack@n-api.service[103664]: spawned uWSGI worker 2 (pid: 103666, cores: 1) Jul 05 12:52:19.702806 dv-cinder-797608-48-iscsi devstack@n-api.service[103664]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 05 12:52:20.374441 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 05 12:52:20.375036 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 05 12:52:21.490798 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 05 12:52:21.490798 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: from cryptography.utils import int_from_bytes Jul 05 12:52:21.491384 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 05 12:52:21.491384 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: from cryptography.utils import int_from_bytes Jul 05 12:52:21.495721 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 05 12:52:21.495721 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: from cryptography.utils import int_from_bytes Jul 05 12:52:21.496194 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 05 12:52:21.496194 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: from cryptography.utils import int_from_bytes Jul 05 12:52:23.945599 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 05 12:52:23.946170 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 05 12:52:23.946345 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 05 12:52:23.946767 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 05 12:52:23.946857 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 05 12:52:23.946941 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 05 12:52:23.946941 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 05 12:52:23.947116 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 05 12:52:23.947327 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.947460 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 05 12:52:23.947653 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.947774 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 05 12:52:23.947973 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.948084 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.948287 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.948408 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.948643 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.948770 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.948958 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.949094 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.949274 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.949426 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.949589 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.949740 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.949913 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.950060 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.950173 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.950394 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.950504 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.950708 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.950805 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-48-iscsi {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.950973 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.951096 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.951290 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.951389 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.951614 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-48-iscsi {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.951702 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.951940 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.952026 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.952248 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.952349 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.952560 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.952663 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.952902 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.952996 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.953208 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.953393 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.953531 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.953818 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.953927 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.954125 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.954338 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.954450 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.954650 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.954742 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.954954 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.955068 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.955267 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.955369 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.956144 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.956234 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.956477 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.956608 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.956804 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.956892 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.957119 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.957213 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.957428 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.957521 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-48-iscsi {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.957751 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.957902 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.958064 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.958164 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.958405 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.958490 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-48-iscsi {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.958761 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.958860 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.959075 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.959169 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.959391 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.959495 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.959708 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.959803 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.960041 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.960135 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.960349 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.960509 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.960699 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.960790 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.961020 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.961109 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.961337 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.961425 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.961656 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.961745 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.961958 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.962051 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.962264 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.962351 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.962570 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.962664 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.962887 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.962978 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.963189 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.963275 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.963490 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.963586 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.963738 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.963833 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.964043 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.964130 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.964361 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.964453 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.964646 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.964748 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.964959 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.965048 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.965246 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.965339 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.965496 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.965593 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.965812 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.965907 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.966133 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.966226 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.966382 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.966470 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.966705 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.966808 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.967028 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.967123 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.967334 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.967422 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.967639 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.967734 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.967944 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.968039 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.968247 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.968338 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.968553 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.968666 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.968887 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.968986 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.969195 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.969281 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.969499 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.969585 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.969807 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.969981 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.970120 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.970204 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.970442 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.970528 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.970746 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.970845 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.971078 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.971169 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.971416 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.971510 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.971744 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.971842 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.972024 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.972111 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.972337 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.972422 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.972681 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.972774 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.972990 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.973085 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.973293 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.973382 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.973599 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.973687 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.973911 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.973995 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.974221 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.974316 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.974527 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.974621 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.974774 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.974860 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.975073 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.975169 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.975375 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.975469 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.975690 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.975784 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.975989 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.976083 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.976291 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.976385 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.976604 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.976739 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.976920 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.977024 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.977222 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.977315 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.977521 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.977605 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.977819 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.977912 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.978121 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.978244 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.978422 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.978514 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.978721 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.978819 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.979023 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.979108 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.979324 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.979409 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.979625 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.979728 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.979931 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.980018 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.980238 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.980335 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.980539 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.980908 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.981131 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.981219 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.981433 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.981529 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.981737 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.981891 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.982046 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.982138 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.982346 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.982431 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.982648 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.982748 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.982963 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.983048 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.983268 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.983352 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.983571 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.983657 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.983884 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.983969 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.984188 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.984274 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.984492 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.984577 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.984830 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.984916 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.985130 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.985227 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.985433 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.985519 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.985745 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.985830 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.986043 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.986128 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.986343 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.986429 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.987165 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.987303 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.987475 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.987571 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.987779 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.987866 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.988080 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.988165 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.988382 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.988481 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.988709 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.988811 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.989010 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.989098 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.989312 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.989411 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.989617 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.989711 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.989918 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.990053 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.990221 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.990316 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.990526 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.990612 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.990837 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.990930 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.991146 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.991233 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:23.991451 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.991544 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:23.991771 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:52:23.991857 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:23.992108 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:23.992203 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:23.992436 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:23.992522 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:23.992792 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:23.992892 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:23.993111 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:23.993198 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:23.993419 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:23.993505 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:23.993732 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:23.993831 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:23.994057 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:23.994143 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:23.994368 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:23.994493 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:23.994679 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:23.994773 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:23.994987 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:23.995072 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:23.995301 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:23.995387 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:23.995612 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:23.995705 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:23.995924 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:23.996011 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:23.996240 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:23.996341 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:23.996554 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:23.996691 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:23.996894 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:23.996990 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:23.997206 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:23.997293 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:23.997524 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:23.997621 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:23.997845 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:23.997934 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:23.998160 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:23.998247 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:23.998467 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:23.998565 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:23.998796 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:23.998881 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:23.999119 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:23.999205 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:23.999432 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:23.999520 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:23.999752 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:23.999838 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.000072 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.000159 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.000383 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.000472 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.000724 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.000827 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.001038 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.001125 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.001354 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.001444 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.001669 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.001762 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.001974 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.002068 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.002339 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.002925 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.003164 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.003251 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.003476 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.003571 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.003787 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.003874 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.004098 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.004194 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.004407 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.004506 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.004742 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.004831 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.005058 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.005156 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.005369 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.005463 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.005683 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.005808 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.005999 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.006101 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.006307 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.006416 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.006614 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.006712 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.006922 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.007028 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.007224 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.007331 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.007532 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.007638 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.007850 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.007949 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.008136 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.008240 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.008433 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.008553 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.008763 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.008859 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.009076 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.009166 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.009378 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.009465 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.009697 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.009791 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.009998 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.010086 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.010310 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.010410 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.010615 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.010710 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.010923 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.011012 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.011225 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.011329 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.011536 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.011641 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.011840 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.011928 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.012142 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.012230 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.012451 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.012546 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.012784 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.012872 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.013088 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.013178 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.013407 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.013504 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.013770 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.013875 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.014041 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.014129 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.014351 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.014451 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.014662 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.014748 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.014966 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.015052 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.015274 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.015374 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.015583 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.015673 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.015894 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.015980 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.016203 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.016291 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.016512 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.016629 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.016860 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.016947 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.017179 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.017270 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.017484 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.017571 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.017809 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.017906 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.018167 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.018256 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.018479 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.018565 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.018782 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.018888 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.019088 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.019187 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.019389 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.019477 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.019689 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.019786 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.019989 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.020077 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.020308 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.020403 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.020628 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.020813 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.020910 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.021001 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.021201 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.021290 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.021499 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.021596 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.021797 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.021886 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.022099 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.022185 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.022407 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.022496 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.022702 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.022788 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.023001 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.023096 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.023301 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.023390 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.023616 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.023703 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.023923 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.024011 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.024229 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.024318 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.024573 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.024682 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.024901 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.024990 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.025231 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.025320 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.025543 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.025632 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.025857 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.025958 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.026169 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.026257 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.026479 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.026567 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.026789 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.026886 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.027096 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.027184 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.027406 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.027492 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.027714 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.027808 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.028026 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.028121 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.028332 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.028418 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.028670 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.028826 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.028980 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.029068 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.029293 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.029387 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.029592 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.029687 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.029906 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.030003 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.030226 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.030320 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.030535 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.030623 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.030856 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.030944 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.031174 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.031260 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.031485 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.031612 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.031799 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.031889 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.032107 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.032205 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.032415 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.032504 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.032759 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.032848 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.033070 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.033158 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.033384 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.033472 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.033717 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.033803 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.034030 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.034132 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.034336 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.034423 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.034655 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.034741 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.034964 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.035065 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.035280 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.035382 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.035580 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.035676 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.035896 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.035992 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.036215 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.036302 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.036524 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.036643 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.036866 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.036971 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.037177 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.037265 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.037502 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.037590 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.037813 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.037901 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.038120 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.038220 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.038429 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.038599 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.038732 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.038821 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.039035 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.039132 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.039342 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.039430 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.039648 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.039743 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.039954 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.040041 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.040263 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.040358 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.040567 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.040691 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.040901 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.040989 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.041207 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.041303 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.041508 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.041596 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.041809 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.041900 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.042117 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.042212 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.042421 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.042515 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.042726 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.042821 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.043040 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.043135 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.043358 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.043460 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.043662 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.043751 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.043964 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.044061 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.044285 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.044382 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.044645 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.044750 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.044916 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.045016 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.045218 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.045306 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.045520 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.045615 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.045835 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.045921 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.046143 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.046231 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.046447 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.046544 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.046762 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.046852 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.047084 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.047195 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.048624 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.048770 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.048770 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.049000 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.049109 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.049719 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.049826 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.049942 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.050058 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.050166 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.050272 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.050396 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.050580 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.050770 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.050889 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.050996 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.051101 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.051206 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.051311 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.051424 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.051539 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.051646 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.051752 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.051858 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.051971 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.052085 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.052193 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.052305 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.052412 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.052518 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.052670 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.052794 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.052903 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.053032 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.053128 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.053211 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.053428 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.053541 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.053743 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.053875 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.054065 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.054189 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.054510 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.054630 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.054827 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.054968 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.055145 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.055289 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.055476 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.055615 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.055803 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.055937 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.056142 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.056264 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.056449 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.056620 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.056789 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.056958 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.057095 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.057305 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.057403 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.057619 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.057717 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.057934 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.058086 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.058245 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.058335 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.058554 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.058651 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.058859 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.058946 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.059162 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.059251 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.059462 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.059558 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.059763 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.059866 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.060069 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.060177 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.060377 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.060473 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.060698 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.060792 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.061009 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.061102 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.061312 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.061413 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.061626 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.061725 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.061932 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.062022 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.062234 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.062327 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.062534 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.062628 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.062833 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.062944 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.063165 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.063427 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.063528 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.063747 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.063847 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.064175 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.064270 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.064926 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.065002 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.065070 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.065150 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.065222 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.065288 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.065516 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.065681 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.065828 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.065986 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.066141 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.066279 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.066418 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.066565 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.066700 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.066857 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.066994 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.067130 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.067264 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.067401 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.067547 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.067684 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.067820 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.067968 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.068111 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.068254 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.068401 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.068545 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.068695 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.068791 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.069000 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.069087 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.069308 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.069397 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.069610 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.069700 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.069925 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.070023 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.070234 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.070330 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.070536 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.070625 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.070837 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.070934 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.071147 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.071236 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.071449 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.071537 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.071747 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.071862 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.072056 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.072153 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.072355 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.072450 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.072681 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.072794 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.072995 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.073096 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.073280 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.073372 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.073579 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.073750 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.073887 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.073975 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.074190 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.074322 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.074486 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.074574 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.074796 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.074883 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.075102 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.075189 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.075404 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.075493 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.075705 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.075794 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.076012 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.076108 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.076314 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.076403 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.076641 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.076731 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.076955 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.077052 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.077262 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.077349 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.077571 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.077666 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.077870 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.077966 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.078179 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.078314 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.078481 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.078569 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.078784 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.078881 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.079087 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.079175 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.079391 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.079477 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.079689 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.079784 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.079989 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.080078 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.080289 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.080920 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.081134 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.081237 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.081438 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.081525 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.081742 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.081829 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.082053 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.082143 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.082351 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.082444 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.082655 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.082751 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.082957 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.083060 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.083280 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.083378 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.083586 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.083672 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.083891 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.083979 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.084232 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.084326 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.084537 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.084664 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.084876 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.084973 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.085186 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.085274 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.085494 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.085592 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.085804 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.085892 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.086106 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.086193 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.086420 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.086517 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.086727 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.086814 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.087036 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.087122 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.087342 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.087449 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.087640 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.087730 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.087957 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.088043 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.088262 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.088401 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.088567 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.088680 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.088906 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.089004 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.089221 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.089316 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.089537 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.089625 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.089837 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.089922 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.090143 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.090231 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.090451 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.090546 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.090757 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.090845 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.091061 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.091149 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.091365 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.091452 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.091673 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.091760 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.091979 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.092068 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.092285 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.092376 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.092616 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.092708 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.092928 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.093019 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.093232 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.093384 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.093539 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.093641 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.093846 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.093942 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.094149 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.094243 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.094459 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.094553 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.094767 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.094855 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.095067 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.095154 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.095373 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.095473 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.095673 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.095762 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.095993 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.096114 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.096327 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.096424 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.096663 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.096767 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.096981 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.097069 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.097289 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.097377 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.097665 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.097751 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.097974 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.098060 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.098280 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.098369 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.098592 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.098683 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.098901 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.098989 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.099203 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.099292 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.099516 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.099603 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.099833 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.099922 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.100144 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.100233 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.100489 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.100575 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.100816 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.100916 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.101116 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.101212 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.101422 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.101524 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.101742 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.101838 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.102043 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.102131 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.102344 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.102433 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.102644 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.102809 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.102961 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.103057 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.103261 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.103396 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.103564 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.103663 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.103889 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.103990 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.104197 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.104287 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.104521 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.104636 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.104963 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.105051 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.105270 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.105357 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.105575 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.105912 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.106146 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.106231 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.106463 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.106550 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.106783 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.106873 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.107085 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.107175 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.107399 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.107496 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.107706 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.107803 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.108026 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.108114 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.108343 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.108439 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.108671 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.108776 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.108985 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.109088 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.109286 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.109382 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.109603 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.109706 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.109919 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.110006 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.110234 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.110345 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.110551 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.110652 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.110872 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.110969 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.111189 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.111287 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.111513 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.112093 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.112372 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.112460 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.112719 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.112812 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.113024 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.113114 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.113325 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.113430 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.113633 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.113739 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.113936 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.114028 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.114238 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.114326 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.114556 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.114665 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.114860 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.114957 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.115165 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.115252 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.115469 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.115564 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.115776 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.115866 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.116074 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.116162 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.116373 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.116460 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.116715 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.116807 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.117019 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.117115 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.117322 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.117417 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.117634 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.117739 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.117945 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.118039 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.118262 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.118357 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.118566 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.118670 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.118886 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.118993 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.119193 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.119290 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.119494 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.119580 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.119794 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.119882 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.120094 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.120191 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.120409 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.120496 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.120739 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.120830 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.121047 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.121137 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.121371 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.121457 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.121686 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.121772 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.121992 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.122080 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.122323 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.122419 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.122647 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.122742 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.122958 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.123045 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.123272 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.123358 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.123591 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.123735 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.123893 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.123982 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.124196 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.124283 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.124503 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.124636 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.124829 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.124929 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.125131 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.125220 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.125432 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.125532 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.125737 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.125826 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.126036 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.126138 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.126335 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.126431 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.126634 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.126722 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.126939 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.127025 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.127264 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.127352 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.127596 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.127682 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.127915 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.127999 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.128217 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.128296 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.128521 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.128619 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.128975 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.129093 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.129187 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.129268 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.129461 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.129556 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.129769 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.129856 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.130090 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.130178 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.130406 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.130496 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.130731 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.130830 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.131039 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.131134 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.131359 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.131447 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.131672 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.131767 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.131984 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.132071 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.132296 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.132384 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.132661 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.132769 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.132934 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.133022 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.133248 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.133335 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.133561 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.133704 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.133868 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.133959 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.134180 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.134281 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.134491 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.134587 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.134804 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.134897 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.135127 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.135319 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.135444 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.135651 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.135768 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.135969 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.136287 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.136375 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.136619 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.136712 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.136940 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.137029 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.137254 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.137350 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.137569 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.137658 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.137884 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.137969 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.138193 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.138288 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.138504 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.138599 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.138818 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.138905 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.139134 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.139246 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.139449 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.139537 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.139782 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.139869 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.140100 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.140196 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.140414 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.140508 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.140762 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.140852 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.141079 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.141169 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.141395 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.141482 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.141716 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.141803 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.142029 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.142117 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.142345 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.142432 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.142660 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.142826 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.143489 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.143578 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.143802 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.143939 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.144114 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.144211 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.144430 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.144524 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.144764 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.144863 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.145078 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.145180 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.145389 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.145477 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.145701 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.145789 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.146013 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.146102 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.146328 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.146422 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.146646 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.146745 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.146964 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.147054 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.147276 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.147362 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.147590 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.147678 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.147902 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.147991 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.148232 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.148421 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.148553 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.148762 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.148896 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.149095 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.149420 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.149517 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.149738 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.149842 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.150051 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.150138 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.150366 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.150498 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.150692 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.150789 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.150999 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.151087 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.151302 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.151391 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.151611 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.151707 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.151920 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.152014 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.152223 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.152320 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.152535 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.152642 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.152871 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.152958 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.153175 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.153273 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.153496 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.153592 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.153804 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.153945 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.154117 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.154326 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.154423 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.154669 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.154756 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.154985 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.155258 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.155353 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.155612 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.155700 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.155926 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.156021 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.156232 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.156329 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.156552 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.156662 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.156882 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.156978 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.157188 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.157285 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.157503 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.157590 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.157811 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.157897 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.158114 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.158209 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.158425 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.158551 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.158789 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.158877 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.159099 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.159187 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.159406 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.159503 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.159717 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.159807 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.160023 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.160112 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.160330 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.160416 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.160664 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.160766 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.160971 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.161067 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.161274 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.161362 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.161585 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.161672 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.161891 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.161983 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.162192 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.162278 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.162496 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.162597 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.162801 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.162887 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.163109 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.163195 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.163412 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.163515 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.163718 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.163804 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.164019 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.164164 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.164328 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.164429 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.164651 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.164751 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.164962 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.165049 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.165275 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.165376 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.165581 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.165670 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.165896 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.165983 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.166196 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.166291 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.166509 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.166596 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.166819 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.166905 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.167142 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.167231 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.167453 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.167541 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.167762 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.167847 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.168087 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.168182 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.168403 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.168496 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.168739 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.168948 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.169091 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.169282 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.169413 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.169602 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.169930 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.170025 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.170260 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.170348 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.170568 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.170656 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.170873 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.170968 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.171176 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.171263 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.171498 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.171585 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.171808 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.171904 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.172119 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.172234 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.172424 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.172525 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.172759 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.172946 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.173069 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.173168 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.173376 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.173468 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.173684 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.173775 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.173991 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.174603 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.174824 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.174922 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.175132 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.175223 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.175486 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.175587 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.175789 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.175888 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.176100 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.176196 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.176410 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.176498 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.176746 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.176857 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.177064 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.177154 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.177381 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.177469 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.177692 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.177788 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.178006 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.178095 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.178315 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.178410 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.178622 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.178721 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.178935 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.179023 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.179242 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.179372 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.179555 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.179722 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.179866 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.180006 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.180156 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.180294 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.180441 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.180576 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.180801 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.180893 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.181119 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.181214 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.181427 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.181516 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.181785 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.181873 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.182094 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.182198 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.182414 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.182502 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.182736 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.182824 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.183046 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.183147 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.183365 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.183459 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.183673 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.183760 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.183990 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.184090 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.184315 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.184407 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.184655 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.184777 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.184982 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.185090 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.185285 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.185382 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.185590 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.185678 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.185895 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.185992 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.186203 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.186291 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.186517 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.186604 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.186823 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.186910 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.187124 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.187211 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.187424 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.187538 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.187734 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.187836 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.188037 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.188124 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.188334 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.188434 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.188657 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.188747 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.188964 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.189050 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.189268 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.189368 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.189568 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.189695 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.189920 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.190012 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.190225 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.190322 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.190525 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.190620 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.190827 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.190925 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.191127 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.191224 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.191429 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.191514 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.191727 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.191822 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.192027 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.192122 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.192327 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.192415 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.192648 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.192750 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.192950 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.193038 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.193251 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.193337 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.193555 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.193641 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.193859 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.193947 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.194192 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.194279 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.194500 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.194596 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.194819 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.194915 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.195131 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.195242 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.195448 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.195551 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.195814 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.195920 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.196080 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.196167 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.196384 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.196479 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.196735 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.196824 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.197044 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.197130 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.197353 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.197450 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.197663 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.197751 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.197971 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.198060 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.198279 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.198376 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.198589 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.198677 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.198903 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.198990 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.199221 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.199309 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.199522 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.199609 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.199840 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.199935 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.200152 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.200239 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.200466 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.200552 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.200803 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.200892 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.201111 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.201200 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.201434 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.201521 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.201742 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.201904 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.202051 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.202140 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.202362 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.202449 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.202668 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.202765 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.202976 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.203064 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.203290 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.203377 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.203601 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.203695 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.203915 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.204004 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.204237 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.204324 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.204544 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.204665 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.204891 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.204979 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.205218 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.205318 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.206063 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.206160 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.206388 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.206477 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.206715 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.206801 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.207044 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.207132 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.207358 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.207452 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.207666 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.207754 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.207969 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.208116 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.208201 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 05 12:52:24.208319 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.208656 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.208967 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:52:24.209214 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 05 12:52:24.269810 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: INFO dbcounter [None req-f8bf3197-acc9-4189-b157-9c7c58f4a1d3 None None] Registered counter for database nova_api Jul 05 12:52:24.272311 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: INFO dbcounter [None req-4e09d59b-ecd9-43a9-8c82-746e5880c9dc None None] Registered counter for database nova_api Jul 05 12:52:24.382098 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG oslo_db.sqlalchemy.engines [None req-f8bf3197-acc9-4189-b157-9c7c58f4a1d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103666) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 12:52:24.383940 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG oslo_db.sqlalchemy.engines [None req-4e09d59b-ecd9-43a9-8c82-746e5880c9dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103665) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 12:52:24.388480 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG dbcounter [-] [103666] Writer thread running {{(pid=103666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 12:52:24.390464 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG dbcounter [-] [103665] Writer thread running {{(pid=103665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 12:52:24.443268 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.context [None req-f8bf3197-acc9-4189-b157-9c7c58f4a1d3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1f103960-fac2-43f5-a4e1-1a426049bf0c(cell1) {{(pid=103666) load_cells /opt/stack/nova/nova/context.py:464}} Jul 05 12:52:24.445436 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.context [None req-4e09d59b-ecd9-43a9-8c82-746e5880c9dc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1f103960-fac2-43f5-a4e1-1a426049bf0c(cell1) {{(pid=103665) load_cells /opt/stack/nova/nova/context.py:464}} Jul 05 12:52:24.447244 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG oslo_concurrency.lockutils [None req-f8bf3197-acc9-4189-b157-9c7c58f4a1d3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 12:52:24.448782 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG oslo_concurrency.lockutils [None req-f8bf3197-acc9-4189-b157-9c7c58f4a1d3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 12:52:24.449382 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG oslo_concurrency.lockutils [None req-4e09d59b-ecd9-43a9-8c82-746e5880c9dc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 12:52:24.449562 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG oslo_concurrency.lockutils [None req-f8bf3197-acc9-4189-b157-9c7c58f4a1d3 None None] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 12:52:24.450965 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG oslo_concurrency.lockutils [None req-4e09d59b-ecd9-43a9-8c82-746e5880c9dc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 12:52:24.451618 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG oslo_concurrency.lockutils [None req-f8bf3197-acc9-4189-b157-9c7c58f4a1d3 None None] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 12:52:24.451736 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG oslo_concurrency.lockutils [None req-4e09d59b-ecd9-43a9-8c82-746e5880c9dc None None] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 12:52:24.453584 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: INFO dbcounter [None req-f8bf3197-acc9-4189-b157-9c7c58f4a1d3 None None] Registered counter for database nova_cell0 Jul 05 12:52:24.453838 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG oslo_concurrency.lockutils [None req-4e09d59b-ecd9-43a9-8c82-746e5880c9dc None None] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 12:52:24.456762 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: INFO dbcounter [None req-4e09d59b-ecd9-43a9-8c82-746e5880c9dc None None] Registered counter for database nova_cell0 Jul 05 12:52:24.458269 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: INFO dbcounter [None req-f8bf3197-acc9-4189-b157-9c7c58f4a1d3 None None] Registered counter for database nova_cell1 Jul 05 12:52:24.460560 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: INFO dbcounter [None req-4e09d59b-ecd9-43a9-8c82-746e5880c9dc None None] Registered counter for database nova_cell1 Jul 05 12:52:24.465649 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG oslo_db.sqlalchemy.engines [None req-f8bf3197-acc9-4189-b157-9c7c58f4a1d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103666) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 12:52:24.467350 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG oslo_db.sqlalchemy.engines [None req-f8bf3197-acc9-4189-b157-9c7c58f4a1d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103666) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 12:52:24.469052 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG oslo_db.sqlalchemy.engines [None req-4e09d59b-ecd9-43a9-8c82-746e5880c9dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103665) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 12:52:24.470931 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG oslo_db.sqlalchemy.engines [None req-4e09d59b-ecd9-43a9-8c82-746e5880c9dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103665) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 12:52:24.472781 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG dbcounter [-] [103666] Writer thread running {{(pid=103666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 12:52:24.476996 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG dbcounter [-] [103665] Writer thread running {{(pid=103665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 12:52:24.479009 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG dbcounter [-] [103665] Writer thread running {{(pid=103665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 12:52:24.609203 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG dbcounter [-] [103666] Writer thread running {{(pid=103666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 12:52:24.619458 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: INFO dbcounter [None req-f8bf3197-acc9-4189-b157-9c7c58f4a1d3 None None] Registered counter for database nova_cell0 Jul 05 12:52:24.623650 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: INFO dbcounter [None req-4e09d59b-ecd9-43a9-8c82-746e5880c9dc None None] Registered counter for database nova_cell0 Jul 05 12:52:24.628613 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG oslo_db.sqlalchemy.engines [None req-f8bf3197-acc9-4189-b157-9c7c58f4a1d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103666) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 12:52:24.630517 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG oslo_db.sqlalchemy.engines [None req-4e09d59b-ecd9-43a9-8c82-746e5880c9dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103665) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 12:52:24.633148 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG dbcounter [-] [103666] Writer thread running {{(pid=103666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 12:52:24.634863 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG dbcounter [-] [103665] Writer thread running {{(pid=103665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 12:52:25.065574 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: WARNING keystonemiddleware.auth_token [None req-f8bf3197-acc9-4189-b157-9c7c58f4a1d3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 05 12:52:25.072502 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: WARNING keystonemiddleware.auth_token [None req-f8bf3197-acc9-4189-b157-9c7c58f4a1d3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 05 12:52:25.097241 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: WARNING keystonemiddleware.auth_token [None req-4e09d59b-ecd9-43a9-8c82-746e5880c9dc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 05 12:52:25.104548 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: WARNING keystonemiddleware.auth_token [None req-4e09d59b-ecd9-43a9-8c82-746e5880c9dc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 05 12:52:25.440632 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: WARNING keystonemiddleware.auth_token [None req-f8bf3197-acc9-4189-b157-9c7c58f4a1d3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 05 12:52:25.442659 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: WARNING keystonemiddleware.auth_token [None req-4e09d59b-ecd9-43a9-8c82-746e5880c9dc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 05 12:52:25.446510 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: WARNING keystonemiddleware.auth_token [None req-f8bf3197-acc9-4189-b157-9c7c58f4a1d3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 05 12:52:25.448533 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: WARNING keystonemiddleware.auth_token [None req-4e09d59b-ecd9-43a9-8c82-746e5880c9dc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 05 12:52:25.452123 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56247a4c69c0 pid: 103666 (default app) Jul 05 12:52:25.453749 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56247a4c69c0 pid: 103665 (default app) Jul 05 12:52:25.454218 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-f8bf3197-acc9-4189-b157-9c7c58f4a1d3 None None] Calling method '>' {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 12:52:25.455943 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-f8bf3197-acc9-4189-b157-9c7c58f4a1d3 None None] 10.222.0.36 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001730 Jul 05 12:52:25.456363 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 1/1] 10.222.0.36 () {50 vars in 788 bytes} [Tue Jul 5 12:52:25 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 12:53:42.471971 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-4e09d59b-ecd9-43a9-8c82-746e5880c9dc None None] Calling method '>' {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 12:53:42.473267 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-4e09d59b-ecd9-43a9-8c82-746e5880c9dc None None] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002051 Jul 05 12:53:42.473677 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 1/2] 10.222.0.36 () {54 vars in 930 bytes} [Tue Jul 5 12:53:42 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 12:53:42.489589 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG dbcounter [-] [103666] Writing DB stats nova_api:SELECT=3 {{(pid=103666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:53:42.490415 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG dbcounter [-] [103666] Writing DB stats nova_cell0:SELECT=3 {{(pid=103666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:53:42.491239 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG dbcounter [-] [103666] Writing DB stats nova_cell1:SELECT=3 {{(pid=103666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:53:42.492064 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG dbcounter [-] [103666] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:53:42.911483 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-26792ca2-1ceb-4c17-9b57-e34cd4ab2d1b admin admin] Calling method '>' {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 12:53:42.941472 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-26792ca2-1ceb-4c17-9b57-e34cd4ab2d1b admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.461764 Jul 05 12:53:42.956613 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 2/3] 10.222.0.36 () {60 vars in 1291 bytes} [Tue Jul 5 12:53:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 12:53:45.004880 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-4e09d59b-ecd9-43a9-8c82-746e5880c9dc None None] Calling method '>' {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 12:53:45.005901 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-4e09d59b-ecd9-43a9-8c82-746e5880c9dc None None] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jul 05 12:53:45.006295 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 2/4] 10.222.0.36 () {54 vars in 930 bytes} [Tue Jul 5 12:53:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 12:53:45.073201 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-da94c5d4-d7b0-4d5a-92a2-649d368fa6f3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "cirros256", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "ram": 256, "disk": 1, "id": "c1"}} {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 12:53:45.091443 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 05 12:53:45.091443 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: warnings.warn(msg) Jul 05 12:53:45.185671 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-da94c5d4-d7b0-4d5a-92a2-649d368fa6f3 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.173371 Jul 05 12:53:45.186300 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 3/5] 10.222.0.36 () {64 vars in 1282 bytes} [Tue Jul 5 12:53:45 2022] POST /compute/v2.1/flavors => generated 407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 12:53:45.201097 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG dbcounter [-] [103665] Writing DB stats nova_api:SELECT=3 {{(pid=103665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:53:45.202488 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG dbcounter [-] [103665] Writing DB stats nova_cell1:SELECT=3 {{(pid=103665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:53:45.203245 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG dbcounter [-] [103665] Writing DB stats nova_cell0:SELECT=3 {{(pid=103665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:53:45.204330 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG dbcounter [-] [103665] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:53:45.410319 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-593d8f6e-fe2e-4d68-a2e4-5a743045f0e2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 12:53:45.412690 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 05 12:53:45.412690 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: warnings.warn(msg) Jul 05 12:53:45.534957 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-593d8f6e-fe2e-4d68-a2e4-5a743045f0e2 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.339684 Jul 05 12:53:45.535748 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 3/6] 10.222.0.36 () {64 vars in 1335 bytes} [Tue Jul 5 12:53:45 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 12:53:47.655811 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-da94c5d4-d7b0-4d5a-92a2-649d368fa6f3 admin admin] Calling method '>' {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 12:53:47.656910 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-da94c5d4-d7b0-4d5a-92a2-649d368fa6f3 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Jul 05 12:53:47.657301 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 4/7] 10.222.0.36 () {54 vars in 930 bytes} [Tue Jul 5 12:53:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 12:53:47.766232 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-1b8ab26a-6a22-44f0-a8f4-0a400b0f5d14 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 5, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "d1", "ram": 512, "name": "ds512M", "vcpus": 1}} {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 12:53:47.784558 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 05 12:53:47.784558 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: warnings.warn(msg) Jul 05 12:53:47.876749 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-1b8ab26a-6a22-44f0-a8f4-0a400b0f5d14 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.211132 Jul 05 12:53:47.877727 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 4/8] 10.222.0.36 () {64 vars in 1282 bytes} [Tue Jul 5 12:53:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 05 12:53:47.890875 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-60d85bc6-9c84-48be-b31c-448866b360ec admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 12:53:47.892516 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 05 12:53:47.892516 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: warnings.warn(msg) Jul 05 12:53:47.994119 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-60d85bc6-9c84-48be-b31c-448866b360ec admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.107881 Jul 05 12:53:47.994623 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 5/9] 10.222.0.36 () {64 vars in 1335 bytes} [Tue Jul 5 12:53:47 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 12:53:50.050884 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-1b8ab26a-6a22-44f0-a8f4-0a400b0f5d14 admin admin] Calling method '>' {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 12:53:50.052579 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-1b8ab26a-6a22-44f0-a8f4-0a400b0f5d14 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002138 Jul 05 12:53:50.054305 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 5/10] 10.222.0.36 () {54 vars in 930 bytes} [Tue Jul 5 12:53:50 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 12:53:50.116015 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-e0ec62b5-9853-4868-83ae-c1049f82fad3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "ds1G", "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "id": "d2", "disk": 10, "swap": 0}} {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 12:53:50.196871 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-e0ec62b5-9853-4868-83ae-c1049f82fad3 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.137720 Jul 05 12:53:50.197599 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 6/11] 10.222.0.36 () {64 vars in 1282 bytes} [Tue Jul 5 12:53:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 12:53:50.209893 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-ebda14e7-4852-483b-92eb-c836587b43ef admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 12:53:50.283647 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-ebda14e7-4852-483b-92eb-c836587b43ef admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.077510 Jul 05 12:53:50.284331 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 6/12] 10.222.0.36 () {64 vars in 1335 bytes} [Tue Jul 5 12:53:50 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 12:53:52.358912 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-e0ec62b5-9853-4868-83ae-c1049f82fad3 admin admin] Calling method '>' {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 12:53:52.360041 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-e0ec62b5-9853-4868-83ae-c1049f82fad3 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001563 Jul 05 12:53:52.360434 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 7/13] 10.222.0.36 () {54 vars in 930 bytes} [Tue Jul 5 12:53:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 12:53:52.418269 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-7246be98-54b4-461a-afda-a28d0ed08903 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d3", "disk": 10, "vcpus": 2, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048}} {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 12:53:52.493133 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-7246be98-54b4-461a-afda-a28d0ed08903 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.126886 Jul 05 12:53:52.493823 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 7/14] 10.222.0.36 () {64 vars in 1282 bytes} [Tue Jul 5 12:53:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 05 12:53:52.507849 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-393daf9c-f76d-45e8-bbc9-95c4d7685f3d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 12:53:52.585491 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-393daf9c-f76d-45e8-bbc9-95c4d7685f3d admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.082094 Jul 05 12:53:52.585995 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 8/15] 10.222.0.36 () {64 vars in 1335 bytes} [Tue Jul 5 12:53:52 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 12:53:54.687809 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-7246be98-54b4-461a-afda-a28d0ed08903 admin admin] Calling method '>' {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 12:53:54.689485 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-7246be98-54b4-461a-afda-a28d0ed08903 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002432 Jul 05 12:53:54.694906 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 8/16] 10.222.0.36 () {54 vars in 930 bytes} [Tue Jul 5 12:53:54 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 12:53:54.757414 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-4b20d452-e30d-4ec4-8de4-b82bde199d34 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "rxtx_factor": 1.0, "name": "ds4G", "id": "d4", "swap": 0, "os-flavor-access:is_public": true, "vcpus": 4}} {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 12:53:54.853863 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-4b20d452-e30d-4ec4-8de4-b82bde199d34 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.157250 Jul 05 12:53:54.854559 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 9/17] 10.222.0.36 () {64 vars in 1282 bytes} [Tue Jul 5 12:53:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 12:53:54.867059 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-81591830-bfbe-426c-a47c-f14f80fb3316 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 12:53:54.946030 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-81591830-bfbe-426c-a47c-f14f80fb3316 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.082544 Jul 05 12:53:54.946809 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 9/18] 10.222.0.36 () {64 vars in 1335 bytes} [Tue Jul 5 12:53:54 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 12:53:57.011435 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-4b20d452-e30d-4ec4-8de4-b82bde199d34 admin admin] Calling method '>' {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 12:53:57.012447 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-4b20d452-e30d-4ec4-8de4-b82bde199d34 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Jul 05 12:53:57.013076 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 10/19] 10.222.0.36 () {54 vars in 930 bytes} [Tue Jul 5 12:53:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 12:53:57.075898 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-91fd80eb-e9e2-4d4f-a6df-71463d4dbb54 admin admin] Calling method '>' {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 12:53:57.096877 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-91fd80eb-e9e2-4d4f-a6df-71463d4dbb54 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.077454 Jul 05 12:53:57.097951 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 10/20] 10.222.0.36 () {60 vars in 1291 bytes} [Tue Jul 5 12:53:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 12:53:59.194731 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-4b20d452-e30d-4ec4-8de4-b82bde199d34 admin admin] Calling method '>' {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 12:53:59.195773 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-4b20d452-e30d-4ec4-8de4-b82bde199d34 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Jul 05 12:53:59.196196 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 11/21] 10.222.0.36 () {54 vars in 930 bytes} [Tue Jul 5 12:53:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 12:53:59.276507 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-5065dabc-63f5-4c38-9193-7339cc55ed7e admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.tiny", "ram": 512, "os-flavor-access:is_public": true, "id": "1", "disk": 1, "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 12:53:59.382600 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-5065dabc-63f5-4c38-9193-7339cc55ed7e admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.177772 Jul 05 12:53:59.383099 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 11/22] 10.222.0.36 () {64 vars in 1282 bytes} [Tue Jul 5 12:53:59 2022] POST /compute/v2.1/flavors => generated 402 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 12:53:59.396415 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-e8ddad6f-97e3-475d-a09e-3670ca691269 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 12:53:59.489537 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-e8ddad6f-97e3-475d-a09e-3670ca691269 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097799 Jul 05 12:53:59.490124 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 12/23] 10.222.0.36 () {64 vars in 1332 bytes} [Tue Jul 5 12:53:59 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 12:54:02.131192 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-5065dabc-63f5-4c38-9193-7339cc55ed7e admin admin] Calling method '>' {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 12:54:02.132259 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-5065dabc-63f5-4c38-9193-7339cc55ed7e admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001662 Jul 05 12:54:02.132695 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 12/24] 10.222.0.36 () {54 vars in 930 bytes} [Tue Jul 5 12:54:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 12:54:02.208650 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-a2efb7f4-8c4f-4340-8907-30595a1206b7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "2", "name": "m1.small", "swap": 0, "ram": 2048, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 12:54:02.299502 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-a2efb7f4-8c4f-4340-8907-30595a1206b7 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.159492 Jul 05 12:54:02.299981 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 13/25] 10.222.0.36 () {64 vars in 1282 bytes} [Tue Jul 5 12:54:02 2022] POST /compute/v2.1/flavors => generated 405 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 12:54:02.313791 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-515b7e47-84a9-4cf4-ab52-4ec59c58950f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 12:54:02.415015 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-515b7e47-84a9-4cf4-ab52-4ec59c58950f admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.105056 Jul 05 12:54:02.415627 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 13/26] 10.222.0.36 () {64 vars in 1332 bytes} [Tue Jul 5 12:54:02 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 12:54:04.653323 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-a2efb7f4-8c4f-4340-8907-30595a1206b7 admin admin] Calling method '>' {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 12:54:04.654815 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-a2efb7f4-8c4f-4340-8907-30595a1206b7 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002127 Jul 05 12:54:04.655214 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 14/27] 10.222.0.36 () {54 vars in 930 bytes} [Tue Jul 5 12:54:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 12:54:04.714327 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-29bce01b-8baa-4867-a605-416f287752f9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 40, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "swap": 0, "rxtx_factor": 1.0, "vcpus": 2, "id": "3"}} {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 12:54:04.813706 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-29bce01b-8baa-4867-a605-416f287752f9 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.152650 Jul 05 12:54:04.814438 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 14/28] 10.222.0.36 () {64 vars in 1282 bytes} [Tue Jul 5 12:54:04 2022] POST /compute/v2.1/flavors => generated 406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 05 12:54:04.826752 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-89e683ff-3e67-4784-a8fd-2663f21c6918 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 12:54:04.919267 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-89e683ff-3e67-4784-a8fd-2663f21c6918 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096778 Jul 05 12:54:04.920332 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 15/29] 10.222.0.36 () {64 vars in 1332 bytes} [Tue Jul 5 12:54:04 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 12:54:06.968675 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-29bce01b-8baa-4867-a605-416f287752f9 admin admin] Calling method '>' {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 12:54:06.969710 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-29bce01b-8baa-4867-a605-416f287752f9 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 Jul 05 12:54:06.970128 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 15/30] 10.222.0.36 () {54 vars in 930 bytes} [Tue Jul 5 12:54:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 12:54:07.033773 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-a9153e7a-eead-42df-a926-5bc1b6d56961 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "os-flavor-access:is_public": true, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "vcpus": 4, "disk": 80, "rxtx_factor": 1.0, "swap": 0}} {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 12:54:07.110319 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-a9153e7a-eead-42df-a926-5bc1b6d56961 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.133322 Jul 05 12:54:07.110865 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 16/31] 10.222.0.36 () {64 vars in 1282 bytes} [Tue Jul 5 12:54:06 2022] POST /compute/v2.1/flavors => generated 405 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 12:54:07.123334 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-d929be1a-a6af-4f00-bf05-f56b0516ad2e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 12:54:07.232712 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-d929be1a-a6af-4f00-bf05-f56b0516ad2e admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.110159 Jul 05 12:54:07.232712 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 16/32] 10.222.0.36 () {64 vars in 1332 bytes} [Tue Jul 5 12:54:07 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 12:54:09.315977 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-a9153e7a-eead-42df-a926-5bc1b6d56961 admin admin] Calling method '>' {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 12:54:09.317030 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-a9153e7a-eead-42df-a926-5bc1b6d56961 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Jul 05 12:54:09.317649 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 17/33] 10.222.0.36 () {54 vars in 930 bytes} [Tue Jul 5 12:54:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 12:54:09.402611 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-3e5db6ef-bcef-489d-a4f6-c2fa124e7569 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "swap": 0, "disk": 160, "vcpus": 8, "ram": 16384, "name": "m1.xlarge"}} {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 12:54:10.041963 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-3e5db6ef-bcef-489d-a4f6-c2fa124e7569 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.717537 Jul 05 12:54:10.042523 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 17/34] 10.222.0.36 () {64 vars in 1282 bytes} [Tue Jul 5 12:54:09 2022] POST /compute/v2.1/flavors => generated 408 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 12:54:10.056483 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-1c458bcf-3cf4-4f0f-bf28-c2641a7d621b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 12:54:10.191602 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-1c458bcf-3cf4-4f0f-bf28-c2641a7d621b admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.138718 Jul 05 12:54:10.192405 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 18/35] 10.222.0.36 () {64 vars in 1332 bytes} [Tue Jul 5 12:54:10 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 12:54:34.213829 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-3e5db6ef-bcef-489d-a4f6-c2fa124e7569 admin admin] Calling method '>' {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 12:54:34.214860 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-3e5db6ef-bcef-489d-a4f6-c2fa124e7569 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Jul 05 12:54:34.215251 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 18/36] 10.222.0.36 () {54 vars in 930 bytes} [Tue Jul 5 12:54:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 12:54:34.225856 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG dbcounter [-] [103666] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:54:34.274366 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-92252a03-6787-4622-82b2-9cd6fe9abef3 admin admin] Calling method '>' {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 12:54:34.291519 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-92252a03-6787-4622-82b2-9cd6fe9abef3 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.070216 Jul 05 12:54:34.292052 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 19/37] 10.222.0.36 () {60 vars in 1291 bytes} [Tue Jul 5 12:54:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 12:54:35.204412 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-3e5db6ef-bcef-489d-a4f6-c2fa124e7569 admin admin] Calling method '>' {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 12:54:35.205451 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-3e5db6ef-bcef-489d-a4f6-c2fa124e7569 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Jul 05 12:54:35.205845 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 19/38] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Jul 5 12:54:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 12:54:35.394584 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-45a18eac-3d03-40af-84ae-eb98a78b7093 admin admin] Calling method '>' {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 12:54:35.400044 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.wsgi [None req-45a18eac-3d03-40af-84ae-eb98a78b7093 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 05 12:54:35.403350 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-45a18eac-3d03-40af-84ae-eb98a78b7093 admin admin] Request method failure captured: Jul 05 12:54:35.403350 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 05 12:54:35.403350 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: Accept: application/json Jul 05 12:54:35.403350 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: Accept-Encoding: gzip, deflate Jul 05 12:54:35.403350 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: Connection: keep-alive Jul 05 12:54:35.403350 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: Content-Length: 0 Jul 05 12:54:35.403350 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: Host: 10.222.0.36 Jul 05 12:54:35.403350 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: Openstack-Api-Version: compute 2.90 Jul 05 12:54:35.403350 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: Openstack-System-Scope: None Jul 05 12:54:35.403350 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: User-Agent: python-novaclient Jul 05 12:54:35.403350 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: X-Auth-Token: gAAAAABixDSLU3ucYBs7vP7kj5rckRu3ULbl5DAyA0zXrMBu-Nl2EUxhwNdJZ7xnbk7Zxul9neOgjUx1mg5Xdk-NEJOeldAaz4cqwtDCI6Dq4ymLBLMwR_JeBl4_lBYFX-dpy3ptflIGYe6aKrekdtBAA57P5u_Oek2Fkfsm2TH-ourxq5jIqMk Jul 05 12:54:35.403350 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: X-Domain-Id: None Jul 05 12:54:35.403350 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: X-Domain-Name: None Jul 05 12:54:35.403350 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: X-Identity-Status: Confirmed Jul 05 12:54:35.403350 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: X-Is-Admin-Project: True Jul 05 12:54:35.403350 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: X-Openstack-Nova-Api-Version: 2.90 Jul 05 12:54:35.403350 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: X-Project-Domain-Id: default Jul 05 12:54:35.403350 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: X-Project-Domain-Name: Default Jul 05 12:54:35.403350 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: X-Project-Id: b34caad9134a4665ac2d8976c95be2ac Jul 05 12:54:35.403350 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: X-Project-Name: admin Jul 05 12:54:35.403350 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: X-Role: member,reader,admin Jul 05 12:54:35.403350 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: X-Roles: member,reader,admin Jul 05 12:54:35.405122 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b34caad9134a4665ac2d8976c95be2ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b34caad9134a4665ac2d8976c95be2ac", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b34caad9134a4665ac2d8976c95be2ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b34caad9134a4665ac2d8976c95be2ac"}]}] Jul 05 12:54:35.405122 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: X-Tenant: admin Jul 05 12:54:35.405122 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: X-Tenant-Id: b34caad9134a4665ac2d8976c95be2ac Jul 05 12:54:35.405122 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: X-Tenant-Name: admin Jul 05 12:54:35.405122 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: X-User: admin Jul 05 12:54:35.405122 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: X-User-Domain-Id: default Jul 05 12:54:35.405122 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: X-User-Domain-Name: Default Jul 05 12:54:35.405122 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: X-User-Id: 1dacaea933b24b6082a79a2c673ec9f1 Jul 05 12:54:35.405122 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: X-User-Name: admin Jul 05 12:54:35.405122 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: method: > Jul 05 12:54:35.405122 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: exception: Flavor 42 could not be found. Jul 05 12:54:35.405122 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: action_args: {'id': '42'} Jul 05 12:54:35.405122 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 12:54:35.405122 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 12:54:35.406249 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 05 12:54:35.406249 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 05 12:54:35.406249 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 05 12:54:35.406249 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 05 12:54:35.406249 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 05 12:54:35.406249 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 05 12:54:35.406249 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 05 12:54:35.406249 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 05 12:54:35.406249 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 05 12:54:35.406249 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 12:54:35.406249 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 05 12:54:35.406249 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 05 12:54:35.406249 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 05 12:54:35.406249 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi Jul 05 12:54:35.406249 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 12:54:35.406249 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi Jul 05 12:54:35.406249 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 12:54:35.406249 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 12:54:35.406249 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 12:54:35.407644 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 12:54:35.407644 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 12:54:35.407644 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 12:54:35.407644 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 12:54:35.407644 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 05 12:54:35.407644 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 05 12:54:35.407644 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 05 12:54:35.407644 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi Jul 05 12:54:35.407644 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 12:54:35.407644 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi Jul 05 12:54:35.407644 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 12:54:35.407644 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 12:54:35.407644 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 12:54:35.407644 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 12:54:35.407644 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 12:54:35.407644 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 05 12:54:35.407644 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi Jul 05 12:54:35.407644 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-45a18eac-3d03-40af-84ae-eb98a78b7093 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 12:54:35.409035 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-45a18eac-3d03-40af-84ae-eb98a78b7093 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.061918 Jul 05 12:54:35.409035 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 20/39] 10.222.0.36 () {60 vars in 1190 bytes} [Tue Jul 5 12:54:35 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 05 12:54:35.414279 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-6c68a24b-ac9b-4a07-9028-7ea592bc566c admin admin] Calling method '>' {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 12:54:35.417302 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG dbcounter [-] [103665] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:54:35.436420 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-6c68a24b-ac9b-4a07-9028-7ea592bc566c admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025671 Jul 05 12:54:35.436973 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 20/40] 10.222.0.36 () {60 vars in 1210 bytes} [Tue Jul 5 12:54:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 12:54:35.446747 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-383e9906-31f8-44a6-9e40-157775f69b15 admin admin] Calling method '>' {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 12:54:35.467680 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-383e9906-31f8-44a6-9e40-157775f69b15 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024838 Jul 05 12:54:35.468198 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 21/41] 10.222.0.36 () {60 vars in 1210 bytes} [Tue Jul 5 12:54:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 12:54:35.477404 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-4e2af4f5-4948-4ea8-a583-5500031cd8eb admin admin] Calling method '>' {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 12:54:35.484000 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.wsgi [None req-4e2af4f5-4948-4ea8-a583-5500031cd8eb admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 05 12:54:35.487229 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-4e2af4f5-4948-4ea8-a583-5500031cd8eb admin admin] Request method failure captured: Jul 05 12:54:35.487229 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 05 12:54:35.487229 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: Accept: application/json Jul 05 12:54:35.487229 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: Accept-Encoding: gzip, deflate Jul 05 12:54:35.487229 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: Connection: keep-alive Jul 05 12:54:35.487229 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: Content-Length: 0 Jul 05 12:54:35.487229 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: Host: 10.222.0.36 Jul 05 12:54:35.487229 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: Openstack-Api-Version: compute 2.90 Jul 05 12:54:35.487229 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: Openstack-System-Scope: None Jul 05 12:54:35.487229 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: User-Agent: python-novaclient Jul 05 12:54:35.487229 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: X-Auth-Token: gAAAAABixDSLU3ucYBs7vP7kj5rckRu3ULbl5DAyA0zXrMBu-Nl2EUxhwNdJZ7xnbk7Zxul9neOgjUx1mg5Xdk-NEJOeldAaz4cqwtDCI6Dq4ymLBLMwR_JeBl4_lBYFX-dpy3ptflIGYe6aKrekdtBAA57P5u_Oek2Fkfsm2TH-ourxq5jIqMk Jul 05 12:54:35.487229 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: X-Domain-Id: None Jul 05 12:54:35.487229 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: X-Domain-Name: None Jul 05 12:54:35.487229 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: X-Identity-Status: Confirmed Jul 05 12:54:35.487229 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: X-Is-Admin-Project: True Jul 05 12:54:35.487229 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: X-Openstack-Nova-Api-Version: 2.90 Jul 05 12:54:35.487229 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: X-Project-Domain-Id: default Jul 05 12:54:35.487229 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: X-Project-Domain-Name: Default Jul 05 12:54:35.487229 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: X-Project-Id: b34caad9134a4665ac2d8976c95be2ac Jul 05 12:54:35.487229 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: X-Project-Name: admin Jul 05 12:54:35.487229 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: X-Role: member,reader,admin Jul 05 12:54:35.487229 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: X-Roles: member,reader,admin Jul 05 12:54:35.488878 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b34caad9134a4665ac2d8976c95be2ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b34caad9134a4665ac2d8976c95be2ac", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b34caad9134a4665ac2d8976c95be2ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b34caad9134a4665ac2d8976c95be2ac"}]}] Jul 05 12:54:35.488878 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: X-Tenant: admin Jul 05 12:54:35.488878 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: X-Tenant-Id: b34caad9134a4665ac2d8976c95be2ac Jul 05 12:54:35.488878 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: X-Tenant-Name: admin Jul 05 12:54:35.488878 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: X-User: admin Jul 05 12:54:35.488878 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: X-User-Domain-Id: default Jul 05 12:54:35.488878 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: X-User-Domain-Name: Default Jul 05 12:54:35.488878 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: X-User-Id: 1dacaea933b24b6082a79a2c673ec9f1 Jul 05 12:54:35.488878 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: X-User-Name: admin Jul 05 12:54:35.488878 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: method: > Jul 05 12:54:35.488878 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: exception: Flavor 42 could not be found. Jul 05 12:54:35.488878 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: action_args: {'id': '42'} Jul 05 12:54:35.488878 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 12:54:35.488878 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 12:54:35.494774 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 05 12:54:35.494774 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 05 12:54:35.494774 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 05 12:54:35.494774 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 05 12:54:35.494774 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 05 12:54:35.494774 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 05 12:54:35.494774 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 05 12:54:35.494774 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 05 12:54:35.494774 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 05 12:54:35.494774 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 12:54:35.494774 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 05 12:54:35.494774 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 05 12:54:35.494774 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 05 12:54:35.494774 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi Jul 05 12:54:35.494774 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 12:54:35.494774 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi Jul 05 12:54:35.494774 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 12:54:35.494774 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 12:54:35.494774 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 12:54:35.495968 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 12:54:35.495968 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 12:54:35.495968 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 12:54:35.495968 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 12:54:35.495968 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 05 12:54:35.495968 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 05 12:54:35.495968 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 05 12:54:35.495968 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi Jul 05 12:54:35.495968 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 12:54:35.495968 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi Jul 05 12:54:35.495968 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 12:54:35.495968 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 12:54:35.495968 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 12:54:35.495968 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 12:54:35.495968 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 12:54:35.495968 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 05 12:54:35.495968 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi Jul 05 12:54:35.495968 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-4e2af4f5-4948-4ea8-a583-5500031cd8eb admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 12:54:35.497507 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-4e2af4f5-4948-4ea8-a583-5500031cd8eb admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014977 Jul 05 12:54:35.497507 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 21/42] 10.222.0.36 () {60 vars in 1190 bytes} [Tue Jul 5 12:54:35 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 05 12:54:36.301854 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-383e9906-31f8-44a6-9e40-157775f69b15 admin admin] Calling method '>' {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 12:54:36.302858 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-383e9906-31f8-44a6-9e40-157775f69b15 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Jul 05 12:54:36.303278 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 22/43] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Jul 5 12:54:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 12:54:36.493162 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-81c024c2-6020-4a3f-a658-4f4773404449 admin admin] Calling method '>' {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 12:54:36.498384 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.wsgi [None req-81c024c2-6020-4a3f-a658-4f4773404449 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 05 12:54:36.499901 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-81c024c2-6020-4a3f-a658-4f4773404449 admin admin] Request method failure captured: Jul 05 12:54:36.499901 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 05 12:54:36.499901 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: Accept: application/json Jul 05 12:54:36.499901 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: Accept-Encoding: gzip, deflate Jul 05 12:54:36.499901 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: Connection: keep-alive Jul 05 12:54:36.499901 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: Content-Length: 0 Jul 05 12:54:36.499901 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: Host: 10.222.0.36 Jul 05 12:54:36.499901 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: Openstack-Api-Version: compute 2.90 Jul 05 12:54:36.499901 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: Openstack-System-Scope: None Jul 05 12:54:36.499901 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: User-Agent: python-novaclient Jul 05 12:54:36.499901 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: X-Auth-Token: gAAAAABixDSMJlm9dB3JiHX_U7w3fpGzy3DTfB0bZYHt2cH6e44xAWFcEIBVraKNfL0ezd4V-GcQmWahTCCq1pUVhtrDRix9K3mjkJpYHSUNbptViTc02r6e7Ieit2wBzFtNCAVRTsEbfe9E4UxyyWAUCVki6zjbwKAGzpNMhO7oFiUQiJyuhy4 Jul 05 12:54:36.499901 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: X-Domain-Id: None Jul 05 12:54:36.499901 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: X-Domain-Name: None Jul 05 12:54:36.499901 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: X-Identity-Status: Confirmed Jul 05 12:54:36.499901 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: X-Is-Admin-Project: True Jul 05 12:54:36.499901 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: X-Openstack-Nova-Api-Version: 2.90 Jul 05 12:54:36.499901 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: X-Project-Domain-Id: default Jul 05 12:54:36.499901 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: X-Project-Domain-Name: Default Jul 05 12:54:36.499901 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: X-Project-Id: b34caad9134a4665ac2d8976c95be2ac Jul 05 12:54:36.499901 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: X-Project-Name: admin Jul 05 12:54:36.499901 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: X-Role: member,reader,admin Jul 05 12:54:36.499901 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: X-Roles: member,reader,admin Jul 05 12:54:36.501355 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b34caad9134a4665ac2d8976c95be2ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b34caad9134a4665ac2d8976c95be2ac", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b34caad9134a4665ac2d8976c95be2ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b34caad9134a4665ac2d8976c95be2ac"}]}] Jul 05 12:54:36.501355 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: X-Tenant: admin Jul 05 12:54:36.501355 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: X-Tenant-Id: b34caad9134a4665ac2d8976c95be2ac Jul 05 12:54:36.501355 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: X-Tenant-Name: admin Jul 05 12:54:36.501355 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: X-User: admin Jul 05 12:54:36.501355 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: X-User-Domain-Id: default Jul 05 12:54:36.501355 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: X-User-Domain-Name: Default Jul 05 12:54:36.501355 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: X-User-Id: 1dacaea933b24b6082a79a2c673ec9f1 Jul 05 12:54:36.501355 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: X-User-Name: admin Jul 05 12:54:36.501355 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: method: > Jul 05 12:54:36.501355 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: exception: Flavor 84 could not be found. Jul 05 12:54:36.501355 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: action_args: {'id': '84'} Jul 05 12:54:36.501355 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 12:54:36.501355 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 12:54:36.502173 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 05 12:54:36.502173 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 05 12:54:36.502173 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 05 12:54:36.502173 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 05 12:54:36.502173 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 05 12:54:36.502173 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 05 12:54:36.502173 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 05 12:54:36.502173 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 05 12:54:36.502173 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 05 12:54:36.502173 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 12:54:36.502173 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 05 12:54:36.502173 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 05 12:54:36.502173 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 05 12:54:36.502173 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi Jul 05 12:54:36.502173 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 12:54:36.502173 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi Jul 05 12:54:36.502173 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 12:54:36.502173 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 12:54:36.502173 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 12:54:36.503262 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 12:54:36.503262 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 12:54:36.503262 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 12:54:36.503262 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 12:54:36.503262 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 05 12:54:36.503262 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 05 12:54:36.503262 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 05 12:54:36.503262 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi Jul 05 12:54:36.503262 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 12:54:36.503262 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi Jul 05 12:54:36.503262 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 12:54:36.503262 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 12:54:36.503262 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 12:54:36.503262 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 12:54:36.503262 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 12:54:36.503262 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 05 12:54:36.503262 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi Jul 05 12:54:36.503262 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-81c024c2-6020-4a3f-a658-4f4773404449 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 12:54:36.504293 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-81c024c2-6020-4a3f-a658-4f4773404449 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.061428 Jul 05 12:54:36.504293 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 22/44] 10.222.0.36 () {60 vars in 1190 bytes} [Tue Jul 5 12:54:36 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 05 12:54:36.510912 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-67fbd338-59ad-4cd7-ae3a-ebbc25480434 admin admin] Calling method '>' {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 12:54:36.525205 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-67fbd338-59ad-4cd7-ae3a-ebbc25480434 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017840 Jul 05 12:54:36.525716 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 23/45] 10.222.0.36 () {60 vars in 1210 bytes} [Tue Jul 5 12:54:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 12:54:36.535434 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-e027b978-7dc1-4c04-9770-3f6c5716f148 admin admin] Calling method '>' {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 12:54:36.549209 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-e027b978-7dc1-4c04-9770-3f6c5716f148 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017246 Jul 05 12:54:36.549725 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 23/46] 10.222.0.36 () {60 vars in 1210 bytes} [Tue Jul 5 12:54:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 12:54:36.559148 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-f84ec486-b0ed-4006-bcae-e9280587d186 admin admin] Calling method '>' {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 12:54:36.564352 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.wsgi [None req-f84ec486-b0ed-4006-bcae-e9280587d186 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 05 12:54:36.565897 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-f84ec486-b0ed-4006-bcae-e9280587d186 admin admin] Request method failure captured: Jul 05 12:54:36.565897 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 05 12:54:36.565897 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: Accept: application/json Jul 05 12:54:36.565897 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: Accept-Encoding: gzip, deflate Jul 05 12:54:36.565897 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: Connection: keep-alive Jul 05 12:54:36.565897 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: Content-Length: 0 Jul 05 12:54:36.565897 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: Host: 10.222.0.36 Jul 05 12:54:36.565897 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: Openstack-Api-Version: compute 2.90 Jul 05 12:54:36.565897 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: Openstack-System-Scope: None Jul 05 12:54:36.565897 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: User-Agent: python-novaclient Jul 05 12:54:36.565897 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: X-Auth-Token: gAAAAABixDSMJlm9dB3JiHX_U7w3fpGzy3DTfB0bZYHt2cH6e44xAWFcEIBVraKNfL0ezd4V-GcQmWahTCCq1pUVhtrDRix9K3mjkJpYHSUNbptViTc02r6e7Ieit2wBzFtNCAVRTsEbfe9E4UxyyWAUCVki6zjbwKAGzpNMhO7oFiUQiJyuhy4 Jul 05 12:54:36.565897 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: X-Domain-Id: None Jul 05 12:54:36.565897 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: X-Domain-Name: None Jul 05 12:54:36.565897 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: X-Identity-Status: Confirmed Jul 05 12:54:36.565897 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: X-Is-Admin-Project: True Jul 05 12:54:36.565897 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: X-Openstack-Nova-Api-Version: 2.90 Jul 05 12:54:36.565897 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: X-Project-Domain-Id: default Jul 05 12:54:36.565897 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: X-Project-Domain-Name: Default Jul 05 12:54:36.565897 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: X-Project-Id: b34caad9134a4665ac2d8976c95be2ac Jul 05 12:54:36.565897 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: X-Project-Name: admin Jul 05 12:54:36.565897 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: X-Role: member,reader,admin Jul 05 12:54:36.565897 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: X-Roles: member,reader,admin Jul 05 12:54:36.567556 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b34caad9134a4665ac2d8976c95be2ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b34caad9134a4665ac2d8976c95be2ac", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b34caad9134a4665ac2d8976c95be2ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b34caad9134a4665ac2d8976c95be2ac"}]}] Jul 05 12:54:36.567556 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: X-Tenant: admin Jul 05 12:54:36.567556 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: X-Tenant-Id: b34caad9134a4665ac2d8976c95be2ac Jul 05 12:54:36.567556 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: X-Tenant-Name: admin Jul 05 12:54:36.567556 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: X-User: admin Jul 05 12:54:36.567556 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: X-User-Domain-Id: default Jul 05 12:54:36.567556 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: X-User-Domain-Name: Default Jul 05 12:54:36.567556 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: X-User-Id: 1dacaea933b24b6082a79a2c673ec9f1 Jul 05 12:54:36.567556 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: X-User-Name: admin Jul 05 12:54:36.567556 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: method: > Jul 05 12:54:36.567556 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: exception: Flavor 84 could not be found. Jul 05 12:54:36.567556 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: action_args: {'id': '84'} Jul 05 12:54:36.567556 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 12:54:36.567556 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 12:54:36.568571 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 05 12:54:36.568571 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 05 12:54:36.568571 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 05 12:54:36.568571 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 05 12:54:36.568571 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 05 12:54:36.568571 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 05 12:54:36.568571 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 05 12:54:36.568571 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 05 12:54:36.568571 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 05 12:54:36.568571 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 12:54:36.568571 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 05 12:54:36.568571 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 05 12:54:36.568571 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 05 12:54:36.568571 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi Jul 05 12:54:36.568571 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 12:54:36.568571 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi Jul 05 12:54:36.568571 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 12:54:36.568571 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 12:54:36.568571 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 12:54:36.569996 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 12:54:36.569996 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 12:54:36.569996 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 12:54:36.569996 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 12:54:36.569996 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 05 12:54:36.569996 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 05 12:54:36.569996 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 05 12:54:36.569996 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi Jul 05 12:54:36.569996 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 12:54:36.569996 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi Jul 05 12:54:36.569996 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 12:54:36.569996 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 12:54:36.569996 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 12:54:36.569996 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 12:54:36.569996 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 12:54:36.569996 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 05 12:54:36.569996 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi Jul 05 12:54:36.569996 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-f84ec486-b0ed-4006-bcae-e9280587d186 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 12:54:36.571271 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-f84ec486-b0ed-4006-bcae-e9280587d186 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012065 Jul 05 12:54:36.571271 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 24/47] 10.222.0.36 () {60 vars in 1190 bytes} [Tue Jul 5 12:54:36 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 05 12:54:37.374583 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-e027b978-7dc1-4c04-9770-3f6c5716f148 admin admin] Calling method '>' {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 12:54:37.375585 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-e027b978-7dc1-4c04-9770-3f6c5716f148 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 Jul 05 12:54:37.375978 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 24/48] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Jul 5 12:54:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 12:54:37.567186 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-b12e0538-3df0-460c-a807-1ddea6d958b5 admin admin] Calling method '>' {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 12:54:37.572865 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.wsgi [None req-b12e0538-3df0-460c-a807-1ddea6d958b5 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 05 12:54:37.574923 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-b12e0538-3df0-460c-a807-1ddea6d958b5 admin admin] Request method failure captured: Jul 05 12:54:37.574923 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 05 12:54:37.574923 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: Accept: application/json Jul 05 12:54:37.574923 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: Accept-Encoding: gzip, deflate Jul 05 12:54:37.574923 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: Connection: keep-alive Jul 05 12:54:37.574923 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: Content-Length: 0 Jul 05 12:54:37.574923 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: Host: 10.222.0.36 Jul 05 12:54:37.574923 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: Openstack-Api-Version: compute 2.90 Jul 05 12:54:37.574923 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: Openstack-System-Scope: None Jul 05 12:54:37.574923 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: User-Agent: python-novaclient Jul 05 12:54:37.574923 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: X-Auth-Token: gAAAAABixDSNuRsQRrCyyY6LJ8il-DnK-0hfbuAbXuM1g7G3KphgIpfzvlh84TgAPkMVO67vw3-sfee4PzMMMXDLk-s-KRy8Fk6ewEL4f-ABdfiFR3E9Al6jQn4KJ5XM6D4RM4cPCjVd_s-gcd3d_b9QlXCQifL1ngfOGsJEM-RxxmDnvXIvp1U Jul 05 12:54:37.574923 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: X-Domain-Id: None Jul 05 12:54:37.574923 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: X-Domain-Name: None Jul 05 12:54:37.574923 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: X-Identity-Status: Confirmed Jul 05 12:54:37.574923 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: X-Is-Admin-Project: True Jul 05 12:54:37.574923 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: X-Openstack-Nova-Api-Version: 2.90 Jul 05 12:54:37.574923 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: X-Project-Domain-Id: default Jul 05 12:54:37.574923 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: X-Project-Domain-Name: Default Jul 05 12:54:37.574923 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: X-Project-Id: b34caad9134a4665ac2d8976c95be2ac Jul 05 12:54:37.574923 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: X-Project-Name: admin Jul 05 12:54:37.574923 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: X-Role: member,reader,admin Jul 05 12:54:37.574923 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: X-Roles: member,reader,admin Jul 05 12:54:37.576485 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b34caad9134a4665ac2d8976c95be2ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b34caad9134a4665ac2d8976c95be2ac", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b34caad9134a4665ac2d8976c95be2ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b34caad9134a4665ac2d8976c95be2ac"}]}] Jul 05 12:54:37.576485 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: X-Tenant: admin Jul 05 12:54:37.576485 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: X-Tenant-Id: b34caad9134a4665ac2d8976c95be2ac Jul 05 12:54:37.576485 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: X-Tenant-Name: admin Jul 05 12:54:37.576485 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: X-User: admin Jul 05 12:54:37.576485 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: X-User-Domain-Id: default Jul 05 12:54:37.576485 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: X-User-Domain-Name: Default Jul 05 12:54:37.576485 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: X-User-Id: 1dacaea933b24b6082a79a2c673ec9f1 Jul 05 12:54:37.576485 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: X-User-Name: admin Jul 05 12:54:37.576485 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: method: > Jul 05 12:54:37.576485 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: exception: Flavor 451 could not be found. Jul 05 12:54:37.576485 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: action_args: {'id': '451'} Jul 05 12:54:37.576485 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 12:54:37.576485 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 12:54:37.577607 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 05 12:54:37.577607 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 05 12:54:37.577607 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 05 12:54:37.577607 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 05 12:54:37.577607 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 05 12:54:37.577607 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 05 12:54:37.577607 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 05 12:54:37.577607 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 05 12:54:37.577607 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 05 12:54:37.577607 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 12:54:37.577607 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 05 12:54:37.577607 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 05 12:54:37.577607 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 05 12:54:37.577607 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi Jul 05 12:54:37.577607 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 12:54:37.577607 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi Jul 05 12:54:37.577607 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 12:54:37.577607 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 12:54:37.577607 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 12:54:37.578890 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 12:54:37.578890 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 12:54:37.578890 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 12:54:37.578890 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 12:54:37.578890 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 05 12:54:37.578890 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 05 12:54:37.578890 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 05 12:54:37.578890 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi Jul 05 12:54:37.578890 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 12:54:37.578890 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi Jul 05 12:54:37.578890 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 12:54:37.578890 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 12:54:37.578890 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 12:54:37.578890 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 12:54:37.578890 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 12:54:37.578890 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 05 12:54:37.578890 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi Jul 05 12:54:37.578890 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-b12e0538-3df0-460c-a807-1ddea6d958b5 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 12:54:37.580176 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-b12e0538-3df0-460c-a807-1ddea6d958b5 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.059412 Jul 05 12:54:37.580176 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 25/49] 10.222.0.36 () {60 vars in 1193 bytes} [Tue Jul 5 12:54:37 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 05 12:54:37.585938 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-e5485fc0-d9d4-4446-b88a-737f7deb0226 admin admin] Calling method '>' {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 12:54:37.599273 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-e5485fc0-d9d4-4446-b88a-737f7deb0226 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017008 Jul 05 12:54:37.599787 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 25/50] 10.222.0.36 () {60 vars in 1210 bytes} [Tue Jul 5 12:54:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 12:54:37.609155 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-b38fdd18-3043-4964-a3ff-8de5b7bbb174 admin admin] Calling method '>' {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 12:54:37.624309 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-b38fdd18-3043-4964-a3ff-8de5b7bbb174 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018966 Jul 05 12:54:37.624856 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 26/51] 10.222.0.36 () {60 vars in 1210 bytes} [Tue Jul 5 12:54:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 12:54:37.633662 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-884a1113-83d5-4dba-a72f-46a55eaaa3a7 admin admin] Calling method '>' {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 12:54:37.639411 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.wsgi [None req-884a1113-83d5-4dba-a72f-46a55eaaa3a7 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 05 12:54:37.640930 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-884a1113-83d5-4dba-a72f-46a55eaaa3a7 admin admin] Request method failure captured: Jul 05 12:54:37.640930 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 05 12:54:37.640930 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: Accept: application/json Jul 05 12:54:37.640930 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: Accept-Encoding: gzip, deflate Jul 05 12:54:37.640930 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: Connection: keep-alive Jul 05 12:54:37.640930 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: Content-Length: 0 Jul 05 12:54:37.640930 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: Host: 10.222.0.36 Jul 05 12:54:37.640930 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: Openstack-Api-Version: compute 2.90 Jul 05 12:54:37.640930 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: Openstack-System-Scope: None Jul 05 12:54:37.640930 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: User-Agent: python-novaclient Jul 05 12:54:37.640930 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: X-Auth-Token: gAAAAABixDSNuRsQRrCyyY6LJ8il-DnK-0hfbuAbXuM1g7G3KphgIpfzvlh84TgAPkMVO67vw3-sfee4PzMMMXDLk-s-KRy8Fk6ewEL4f-ABdfiFR3E9Al6jQn4KJ5XM6D4RM4cPCjVd_s-gcd3d_b9QlXCQifL1ngfOGsJEM-RxxmDnvXIvp1U Jul 05 12:54:37.640930 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: X-Domain-Id: None Jul 05 12:54:37.640930 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: X-Domain-Name: None Jul 05 12:54:37.640930 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: X-Identity-Status: Confirmed Jul 05 12:54:37.640930 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: X-Is-Admin-Project: True Jul 05 12:54:37.640930 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: X-Openstack-Nova-Api-Version: 2.90 Jul 05 12:54:37.640930 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: X-Project-Domain-Id: default Jul 05 12:54:37.640930 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: X-Project-Domain-Name: Default Jul 05 12:54:37.640930 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: X-Project-Id: b34caad9134a4665ac2d8976c95be2ac Jul 05 12:54:37.640930 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: X-Project-Name: admin Jul 05 12:54:37.640930 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: X-Role: member,reader,admin Jul 05 12:54:37.640930 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: X-Roles: member,reader,admin Jul 05 12:54:37.642372 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b34caad9134a4665ac2d8976c95be2ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b34caad9134a4665ac2d8976c95be2ac", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b34caad9134a4665ac2d8976c95be2ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b34caad9134a4665ac2d8976c95be2ac"}]}] Jul 05 12:54:37.642372 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: X-Tenant: admin Jul 05 12:54:37.642372 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: X-Tenant-Id: b34caad9134a4665ac2d8976c95be2ac Jul 05 12:54:37.642372 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: X-Tenant-Name: admin Jul 05 12:54:37.642372 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: X-User: admin Jul 05 12:54:37.642372 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: X-User-Domain-Id: default Jul 05 12:54:37.642372 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: X-User-Domain-Name: Default Jul 05 12:54:37.642372 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: X-User-Id: 1dacaea933b24b6082a79a2c673ec9f1 Jul 05 12:54:37.642372 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: X-User-Name: admin Jul 05 12:54:37.642372 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: method: > Jul 05 12:54:37.642372 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: exception: Flavor 451 could not be found. Jul 05 12:54:37.642372 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: action_args: {'id': '451'} Jul 05 12:54:37.642372 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 12:54:37.642372 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 12:54:37.643269 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 05 12:54:37.643269 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 05 12:54:37.643269 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 05 12:54:37.643269 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 05 12:54:37.643269 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 05 12:54:37.643269 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 05 12:54:37.643269 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 05 12:54:37.643269 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 05 12:54:37.643269 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 05 12:54:37.643269 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 12:54:37.643269 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 05 12:54:37.643269 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 05 12:54:37.643269 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 05 12:54:37.643269 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi Jul 05 12:54:37.643269 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 12:54:37.643269 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi Jul 05 12:54:37.643269 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 12:54:37.643269 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 12:54:37.643269 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 12:54:37.644440 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 12:54:37.644440 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 12:54:37.644440 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 12:54:37.644440 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 12:54:37.644440 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 05 12:54:37.644440 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 05 12:54:37.644440 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 05 12:54:37.644440 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi Jul 05 12:54:37.644440 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 12:54:37.644440 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi Jul 05 12:54:37.644440 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 12:54:37.644440 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 12:54:37.644440 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 12:54:37.644440 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 12:54:37.644440 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 12:54:37.644440 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 05 12:54:37.644440 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi Jul 05 12:54:37.644440 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-884a1113-83d5-4dba-a72f-46a55eaaa3a7 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 12:54:37.645816 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-884a1113-83d5-4dba-a72f-46a55eaaa3a7 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012051 Jul 05 12:54:37.645816 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 26/52] 10.222.0.36 () {60 vars in 1193 bytes} [Tue Jul 5 12:54:37 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 05 12:54:38.462642 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-b38fdd18-3043-4964-a3ff-8de5b7bbb174 admin admin] Calling method '>' {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 12:54:38.463627 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-b38fdd18-3043-4964-a3ff-8de5b7bbb174 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001399 Jul 05 12:54:38.464017 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 27/53] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Jul 5 12:54:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 12:54:38.651483 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-839d300e-0338-41bd-8421-438afdea54a3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 12:54:38.747056 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-839d300e-0338-41bd-8421-438afdea54a3 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.146461 Jul 05 12:54:38.747534 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 27/54] 10.222.0.36 () {64 vars in 1235 bytes} [Tue Jul 5 12:54:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 05 12:54:39.571852 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-b38fdd18-3043-4964-a3ff-8de5b7bbb174 admin admin] Calling method '>' {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 12:54:39.572910 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-b38fdd18-3043-4964-a3ff-8de5b7bbb174 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Jul 05 12:54:39.573300 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 28/55] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Jul 5 12:54:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 12:54:39.762295 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-6e32e915-8a36-4a98-bacb-d4176e02c806 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 12:54:39.861714 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-6e32e915-8a36-4a98-bacb-d4176e02c806 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.150358 Jul 05 12:54:39.862192 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 28/56] 10.222.0.36 () {64 vars in 1235 bytes} [Tue Jul 5 12:54:39 2022] POST /compute/v2.1/flavors => generated 405 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 05 12:54:40.670125 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-b38fdd18-3043-4964-a3ff-8de5b7bbb174 admin admin] Calling method '>' {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 12:54:40.671118 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-b38fdd18-3043-4964-a3ff-8de5b7bbb174 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001403 Jul 05 12:54:40.671515 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 29/57] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Jul 5 12:54:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 12:54:40.894982 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-58f80dbe-2799-4bea-ab01-8cb69f75ab06 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 12:54:40.971479 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-58f80dbe-2799-4bea-ab01-8cb69f75ab06 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.128146 Jul 05 12:54:40.972018 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 29/58] 10.222.0.36 () {64 vars in 1235 bytes} [Tue Jul 5 12:54:40 2022] POST /compute/v2.1/flavors => generated 407 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 12:54:41.791967 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-b38fdd18-3043-4964-a3ff-8de5b7bbb174 admin admin] Calling method '>' {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 12:54:41.792986 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-b38fdd18-3043-4964-a3ff-8de5b7bbb174 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001397 Jul 05 12:54:41.793370 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 30/59] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Jul 5 12:54:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 12:54:41.983632 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-52d906b9-2d0b-42db-b86d-b59f413ae1aa admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 12:54:42.069716 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-52d906b9-2d0b-42db-b86d-b59f413ae1aa admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.136589 Jul 05 12:54:42.070253 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 30/60] 10.222.0.36 () {64 vars in 1235 bytes} [Tue Jul 5 12:54:41 2022] POST /compute/v2.1/flavors => generated 409 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 12:54:42.887225 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-b38fdd18-3043-4964-a3ff-8de5b7bbb174 admin admin] Calling method '>' {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 12:54:42.888212 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-b38fdd18-3043-4964-a3ff-8de5b7bbb174 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Jul 05 12:54:42.888622 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 31/61] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Jul 5 12:54:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 12:54:43.076754 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-21ae7a56-5e18-4a3d-b5bc-b33aa27875e4 admin admin] Calling method '>' {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 12:54:43.096652 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-21ae7a56-5e18-4a3d-b5bc-b33aa27875e4 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.072506 Jul 05 12:54:43.097115 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 31/62] 10.222.0.36 () {60 vars in 1202 bytes} [Tue Jul 5 12:54:43 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 12:55:29.571009 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-b38fdd18-3043-4964-a3ff-8de5b7bbb174 admin admin] Calling method '>' {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 12:55:29.572515 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-b38fdd18-3043-4964-a3ff-8de5b7bbb174 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001927 Jul 05 12:55:29.572966 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 32/63] 10.222.0.36 () {54 vars in 930 bytes} [Tue Jul 5 12:55:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 12:55:29.583306 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG dbcounter [-] [103665] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:55:29.630752 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-3e3379fa-4add-4ceb-840f-ea3cd7945db1 admin admin] Calling method '>' {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 12:55:29.650678 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-3e3379fa-4add-4ceb-840f-ea3cd7945db1 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.071810 Jul 05 12:55:29.651221 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 32/64] 10.222.0.36 () {60 vars in 1291 bytes} [Tue Jul 5 12:55:29 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 12:55:29.673761 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-42939444-37dd-4a98-b23b-d361f76e1b75 admin admin] Calling method '>' {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 12:55:29.677262 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG dbcounter [-] [103666] Writing DB stats nova_api:SELECT=14 {{(pid=103666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:55:29.682156 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-42939444-37dd-4a98-b23b-d361f76e1b75 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012042 Jul 05 12:55:29.682665 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 33/65] 10.222.0.36 () {60 vars in 1282 bytes} [Tue Jul 5 12:55:29 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 12:55:29.694383 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-2f3090e9-fa99-4df6-8e08-f1ffd1abdb5c admin admin] Calling method '>' {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 12:55:29.702528 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-2f3090e9-fa99-4df6-8e08-f1ffd1abdb5c admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012069 Jul 05 12:55:29.703032 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 33/66] 10.222.0.36 () {60 vars in 1285 bytes} [Tue Jul 5 12:55:29 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 12:55:29.714887 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-aaabdabf-c97f-4347-81e1-e13eb49e52b7 admin admin] Calling method '>' {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 12:55:29.722267 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-aaabdabf-c97f-4347-81e1-e13eb49e52b7 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011411 Jul 05 12:55:29.722772 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 34/67] 10.222.0.36 () {60 vars in 1285 bytes} [Tue Jul 5 12:55:29 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 12:55:29.734082 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-d7ed4ce0-7407-4139-bf25-49382b66f0de admin admin] Calling method '>' {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 12:55:29.741671 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-d7ed4ce0-7407-4139-bf25-49382b66f0de admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011325 Jul 05 12:55:29.742184 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 34/68] 10.222.0.36 () {60 vars in 1282 bytes} [Tue Jul 5 12:55:29 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 12:58:54.542346 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-aaabdabf-c97f-4347-81e1-e13eb49e52b7 admin admin] Calling method '>' {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 12:58:54.543349 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-aaabdabf-c97f-4347-81e1-e13eb49e52b7 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Jul 05 12:58:54.543739 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 35/69] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Jul 5 12:58:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 12:58:54.684627 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG dbcounter [-] [103665] Writing DB stats nova_api:SELECT=6 {{(pid=103665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:58:54.802575 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-fc096210-16c1-46c6-8bca-14ba9cb7d4a6 admin admin] Calling method '>' {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 12:58:54.803753 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 05 12:58:54.803753 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: warnings.warn(msg) Jul 05 12:58:54.805055 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG oslo_concurrency.lockutils [None req-fc096210-16c1-46c6-8bca-14ba9cb7d4a6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 12:58:54.805498 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG oslo_concurrency.lockutils [None req-fc096210-16c1-46c6-8bca-14ba9cb7d4a6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 12:58:54.806851 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG oslo_concurrency.lockutils [None req-fc096210-16c1-46c6-8bca-14ba9cb7d4a6 admin admin] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 12:58:54.807619 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG oslo_concurrency.lockutils [None req-fc096210-16c1-46c6-8bca-14ba9cb7d4a6 admin admin] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 12:58:54.845725 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-fc096210-16c1-46c6-8bca-14ba9cb7d4a6 admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.162554 Jul 05 12:58:54.846298 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 35/70] 10.222.0.36 () {60 vars in 1193 bytes} [Tue Jul 5 12:58:54 2022] GET /compute/v2.1/os-services => generated 794 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 12:58:55.668168 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-aaabdabf-c97f-4347-81e1-e13eb49e52b7 admin admin] Calling method '>' {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 12:58:55.669199 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-aaabdabf-c97f-4347-81e1-e13eb49e52b7 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Jul 05 12:58:55.669587 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 36/71] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Jul 5 12:58:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 12:58:55.859759 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-1310f01d-db89-4507-8166-8ee2e38daec3 admin admin] Calling method '>' {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 12:58:55.860959 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 05 12:58:55.860959 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: warnings.warn(msg) Jul 05 12:58:55.862169 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG oslo_concurrency.lockutils [None req-1310f01d-db89-4507-8166-8ee2e38daec3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 12:58:55.862603 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG oslo_concurrency.lockutils [None req-1310f01d-db89-4507-8166-8ee2e38daec3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 12:58:55.863380 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG oslo_concurrency.lockutils [None req-1310f01d-db89-4507-8166-8ee2e38daec3 admin admin] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 12:58:55.863805 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG oslo_concurrency.lockutils [None req-1310f01d-db89-4507-8166-8ee2e38daec3 admin admin] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 12:58:55.883490 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-1310f01d-db89-4507-8166-8ee2e38daec3 admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.076283 Jul 05 12:58:55.884042 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 36/72] 10.222.0.36 () {60 vars in 1193 bytes} [Tue Jul 5 12:58:55 2022] GET /compute/v2.1/os-services => generated 794 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 12:59:07.123545 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-aaabdabf-c97f-4347-81e1-e13eb49e52b7 admin admin] Calling method '>' {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 12:59:07.124771 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-aaabdabf-c97f-4347-81e1-e13eb49e52b7 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Jul 05 12:59:07.128161 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 37/73] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Jul 5 12:59:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 12:59:07.285984 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG dbcounter [-] [103665] Writing DB stats nova_cell0:SELECT=4 {{(pid=103665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:07.286719 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG dbcounter [-] [103665] Writing DB stats nova_cell1:SELECT=4 {{(pid=103665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:07.287345 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG dbcounter [-] [103665] Writing DB stats nova_api:SELECT=8 {{(pid=103665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:07.335548 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-d1d71bf8-5267-441f-890b-6eb3f0f32d63 admin admin] Calling method '>' {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 12:59:07.336887 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 05 12:59:07.336887 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: warnings.warn(msg) Jul 05 12:59:07.338083 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG oslo_concurrency.lockutils [None req-d1d71bf8-5267-441f-890b-6eb3f0f32d63 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 12:59:07.338526 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG oslo_concurrency.lockutils [None req-d1d71bf8-5267-441f-890b-6eb3f0f32d63 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 12:59:07.339330 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG oslo_concurrency.lockutils [None req-d1d71bf8-5267-441f-890b-6eb3f0f32d63 admin admin] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 12:59:07.339747 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG oslo_concurrency.lockutils [None req-d1d71bf8-5267-441f-890b-6eb3f0f32d63 admin admin] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 12:59:07.365030 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-d1d71bf8-5267-441f-890b-6eb3f0f32d63 admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.083319 Jul 05 12:59:07.365592 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 37/74] 10.222.0.36 () {60 vars in 1193 bytes} [Tue Jul 5 12:59:07 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 12:59:08.194909 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-aaabdabf-c97f-4347-81e1-e13eb49e52b7 admin admin] Calling method '>' {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 12:59:08.195997 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-aaabdabf-c97f-4347-81e1-e13eb49e52b7 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001544 Jul 05 12:59:08.196402 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 38/75] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Jul 5 12:59:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 12:59:08.397377 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-68a1c58b-cf89-4706-bc5f-19084d19b7c4 admin admin] Calling method '>' {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 12:59:08.399036 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 05 12:59:08.399036 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: warnings.warn(msg) Jul 05 12:59:08.400216 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG oslo_concurrency.lockutils [None req-68a1c58b-cf89-4706-bc5f-19084d19b7c4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 12:59:08.400794 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG oslo_concurrency.lockutils [None req-68a1c58b-cf89-4706-bc5f-19084d19b7c4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 12:59:08.401640 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG oslo_concurrency.lockutils [None req-68a1c58b-cf89-4706-bc5f-19084d19b7c4 admin admin] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 12:59:08.402195 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: DEBUG oslo_concurrency.lockutils [None req-68a1c58b-cf89-4706-bc5f-19084d19b7c4 admin admin] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 12:59:08.427417 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-68a1c58b-cf89-4706-bc5f-19084d19b7c4 admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.092673 Jul 05 12:59:08.427951 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 38/76] 10.222.0.36 () {60 vars in 1193 bytes} [Tue Jul 5 12:59:08 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:00:06.389773 dv-cinder-797608-48-iscsi devstack@n-api.service[103664]: Tue Jul 5 13:00:06 2022 - graceful shutdown triggered... Jul 05 13:00:06.390317 dv-cinder-797608-48-iscsi devstack@n-api.service[103665]: Gracefully killing worker 1 (pid: 103665)... Jul 05 13:00:06.390679 dv-cinder-797608-48-iscsi devstack@n-api.service[103666]: Gracefully killing worker 2 (pid: 103666)... Jul 05 13:00:06.391948 dv-cinder-797608-48-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 05 13:00:07.390999 dv-cinder-797608-48-iscsi devstack@n-api.service[103664]: worker 1 buried after 1 seconds Jul 05 13:00:07.390999 dv-cinder-797608-48-iscsi devstack@n-api.service[103664]: worker 2 buried after 1 seconds Jul 05 13:00:07.390999 dv-cinder-797608-48-iscsi devstack@n-api.service[103664]: goodbye to uWSGI. Jul 05 13:00:07.392539 dv-cinder-797608-48-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 05 13:00:07.393143 dv-cinder-797608-48-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 05 13:00:07.395988 dv-cinder-797608-48-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 05 13:00:07.405791 dv-cinder-797608-48-iscsi devstack@n-api.service[118374]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 05 13:00:07.407745 dv-cinder-797608-48-iscsi devstack@n-api.service[118374]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 5 13:00:07 2022] *** Jul 05 13:00:07.407745 dv-cinder-797608-48-iscsi devstack@n-api.service[118374]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 05 13:00:07.407745 dv-cinder-797608-48-iscsi devstack@n-api.service[118374]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 05 13:00:07.407745 dv-cinder-797608-48-iscsi devstack@n-api.service[118374]: nodename: dv-cinder-797608-48-iscsi Jul 05 13:00:07.407745 dv-cinder-797608-48-iscsi devstack@n-api.service[118374]: machine: x86_64 Jul 05 13:00:07.407745 dv-cinder-797608-48-iscsi devstack@n-api.service[118374]: clock source: unix Jul 05 13:00:07.407745 dv-cinder-797608-48-iscsi devstack@n-api.service[118374]: pcre jit disabled Jul 05 13:00:07.407745 dv-cinder-797608-48-iscsi devstack@n-api.service[118374]: detected number of CPU cores: 4 Jul 05 13:00:07.407745 dv-cinder-797608-48-iscsi devstack@n-api.service[118374]: current working directory: / Jul 05 13:00:07.407745 dv-cinder-797608-48-iscsi devstack@n-api.service[118374]: detected binary path: /usr/bin/uwsgi-core Jul 05 13:00:07.408539 dv-cinder-797608-48-iscsi devstack@n-api.service[118374]: your processes number limit is 47680 Jul 05 13:00:07.408539 dv-cinder-797608-48-iscsi devstack@n-api.service[118374]: your memory page size is 4096 bytes Jul 05 13:00:07.408539 dv-cinder-797608-48-iscsi devstack@n-api.service[118374]: detected max file descriptor number: 2048 Jul 05 13:00:07.408539 dv-cinder-797608-48-iscsi devstack@n-api.service[118374]: lock engine: pthread robust mutexes Jul 05 13:00:07.408539 dv-cinder-797608-48-iscsi devstack@n-api.service[118374]: thunder lock: enabled Jul 05 13:00:07.408539 dv-cinder-797608-48-iscsi devstack@n-api.service[118374]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 05 13:00:07.408539 dv-cinder-797608-48-iscsi devstack@n-api.service[118374]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 05 13:00:07.451734 dv-cinder-797608-48-iscsi devstack@n-api.service[118374]: Python main interpreter initialized at 0x55bbf9fb29c0 Jul 05 13:00:07.451931 dv-cinder-797608-48-iscsi devstack@n-api.service[118374]: python threads support enabled Jul 05 13:00:07.451931 dv-cinder-797608-48-iscsi devstack@n-api.service[118374]: your server socket listen backlog is limited to 100 connections Jul 05 13:00:07.451931 dv-cinder-797608-48-iscsi devstack@n-api.service[118374]: your mercy for graceful operations on workers is 90 seconds Jul 05 13:00:07.452172 dv-cinder-797608-48-iscsi devstack@n-api.service[118374]: mapped 403077 bytes (393 KB) for 2 cores Jul 05 13:00:07.452255 dv-cinder-797608-48-iscsi devstack@n-api.service[118374]: *** Operational MODE: preforking *** Jul 05 13:00:07.452473 dv-cinder-797608-48-iscsi devstack@n-api.service[118374]: *** uWSGI is running in multiple interpreter mode *** Jul 05 13:00:07.452473 dv-cinder-797608-48-iscsi devstack@n-api.service[118374]: spawned uWSGI master process (pid: 118374) Jul 05 13:00:07.452697 dv-cinder-797608-48-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 05 13:00:07.460754 dv-cinder-797608-48-iscsi devstack@n-api.service[118374]: spawned uWSGI worker 1 (pid: 118386, cores: 1) Jul 05 13:00:07.460754 dv-cinder-797608-48-iscsi devstack@n-api.service[118374]: spawned uWSGI worker 2 (pid: 118387, cores: 1) Jul 05 13:00:07.460754 dv-cinder-797608-48-iscsi devstack@n-api.service[118374]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 05 13:00:08.116542 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 05 13:00:08.126150 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 05 13:00:09.321317 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 05 13:00:09.321317 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: from cryptography.utils import int_from_bytes Jul 05 13:00:09.321958 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 05 13:00:09.321958 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: from cryptography.utils import int_from_bytes Jul 05 13:00:09.346434 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 05 13:00:09.346434 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: from cryptography.utils import int_from_bytes Jul 05 13:00:09.347007 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 05 13:00:09.347007 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: from cryptography.utils import int_from_bytes Jul 05 13:00:11.688867 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 05 13:00:11.689421 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 05 13:00:11.689735 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 05 13:00:11.689989 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 05 13:00:11.690254 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 05 13:00:11.690645 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.690971 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.691299 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.691618 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.691950 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.692262 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.692615 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.692923 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.693255 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.693517 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.693833 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.694159 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-48-iscsi {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.694482 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.694789 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.695099 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.695418 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.695725 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.696046 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.696350 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.696875 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.698244 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.698244 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.698244 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.698673 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.698878 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.701559 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.701702 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 05 13:00:11.701702 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 05 13:00:11.702168 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.702168 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.702324 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 05 13:00:11.702406 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.702480 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 05 13:00:11.702561 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.702648 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 05 13:00:11.702722 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-48-iscsi {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.702806 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.702889 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.702970 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.703056 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.703131 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.703235 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.703317 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.703400 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.703488 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.703568 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.703640 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.703722 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.703804 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.703900 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.703990 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.704110 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.704228 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.704312 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.704393 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.704467 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.704553 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.705177 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.705408 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-48-iscsi {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.705634 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.705895 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.706127 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.706363 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.706587 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.706810 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.707030 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.707242 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.707466 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.707691 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.707916 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.708139 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.708363 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.708536 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.708737 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.708737 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.709048 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.709219 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.709379 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.709534 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.709690 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.709838 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.709983 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.710136 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.710297 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.710459 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.710459 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.712065 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.712234 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.712398 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.712551 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.712758 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.712918 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.713076 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.713225 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.713371 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.713531 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.713693 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.713848 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.713848 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.714141 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-48-iscsi {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.714299 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.714446 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.714603 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.714757 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.714905 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.715060 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.715222 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.715222 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.716053 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.716220 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.716373 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.716526 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.716719 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.716877 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.717034 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.717034 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.717320 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.717320 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.717613 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.717769 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.717932 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.718080 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.718233 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.718440 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.718597 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.718747 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.718903 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.719059 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.719215 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.719377 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.719562 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.719712 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.719870 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.720028 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.720183 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.720345 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.720492 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.720759 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.720924 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.721079 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.721225 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.721386 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.721539 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.721687 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.721840 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.721997 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.721997 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.722305 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.722453 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.722604 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.722604 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.722893 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.723105 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.723266 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.723413 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.723567 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.723567 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.723883 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.724045 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.724198 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.724345 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.724497 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.724729 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.724899 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.725055 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.725211 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.725358 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.725514 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.725676 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.725837 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.725996 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.726143 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.726299 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.726454 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.726609 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.726769 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.726927 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.727081 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.727236 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.727382 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.727534 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.727697 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.727845 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.728007 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.728165 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.728606 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.728780 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.728939 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.729092 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.729253 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.729408 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.729563 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.729718 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.729866 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.730011 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.730501 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.730676 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.730676 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.730977 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.731720 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.731889 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.732053 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.732202 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.732356 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.732505 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.732675 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.732836 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.732994 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.733154 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.733308 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.733463 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.733617 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.733778 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.733926 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.734072 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.734225 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.734373 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.734520 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.734676 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.734831 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.735032 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.735198 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.735353 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.735507 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.735664 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.735812 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.735968 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.736115 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.736270 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.736420 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.736576 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.736812 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.736968 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.737116 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.737419 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.737595 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.737769 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.737924 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.738078 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.738233 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.738387 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.738550 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.738699 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.738846 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.738998 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.739151 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.739305 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.739478 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.739633 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.739790 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.739945 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.740092 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.740238 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.740399 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.740557 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.740738 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.740888 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.741042 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.741203 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.741366 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.741521 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.741676 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.741837 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.741992 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.742138 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.742284 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.742430 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.742591 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.742738 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.742892 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.743039 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.743186 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.743341 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.743498 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.743645 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.743798 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.743954 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.744101 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.744247 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.744402 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.744673 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.744840 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.744990 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.745137 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.745290 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.745460 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.745607 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.745753 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.745910 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.746058 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.746221 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.746372 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.746526 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.746698 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.746851 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.747005 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.747168 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.747333 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.747488 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.747641 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.747788 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.747933 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.748091 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.748240 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.748385 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.748531 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.748737 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.748886 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.749055 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.749218 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.749375 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.749521 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.749673 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.749821 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.749973 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 13:00:11.750193 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.750369 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.750615 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.750792 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.750944 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.751101 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.751248 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.751403 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.751569 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.751717 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.751865 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.752024 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.752179 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.752328 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.752485 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.752649 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.752825 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.752983 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.753132 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.753285 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.753445 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.753600 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.753747 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.753912 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.754068 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.754215 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.754368 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.754516 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.754677 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.754824 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.754977 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.754977 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.755263 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.755422 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.755582 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.755730 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.755902 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.756629 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.756819 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.756973 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.757131 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.757280 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.757427 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.757583 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.757742 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.757890 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.758063 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.758219 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.758373 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.758521 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.758669 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.758873 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.759035 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.759191 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.759348 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.759503 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.759653 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.759809 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.759958 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.760116 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.760270 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.760425 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.760573 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.760766 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.760923 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.761071 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.761218 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.761371 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.761528 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.761686 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.761834 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.761991 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.761991 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.762777 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.762948 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.763095 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.763249 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.763409 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.763559 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.763751 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.763914 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.764069 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.764217 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.764365 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.764533 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.764705 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.764866 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.765021 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.765169 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.765315 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.765469 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.765623 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.765780 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.765937 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.766093 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.766258 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.766415 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.766582 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.766738 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.766886 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.767042 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.767189 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.767343 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.767506 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.768254 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.768415 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.768576 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.768787 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.768946 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.769095 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.769253 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.769653 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.769812 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.769960 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.770107 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.770255 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.770530 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.770709 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.770900 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.771063 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.771215 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.771386 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.771544 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.771702 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.771851 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.771851 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.772137 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.772285 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.772440 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.772617 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.772772 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.772930 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.773086 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.773086 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.773392 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.773540 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.773687 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.773833 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.773990 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.774137 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.774292 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.774440 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.774586 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.774732 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.774885 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.775039 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.775210 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.775365 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.775514 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.775668 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.775822 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.775976 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.776138 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.776292 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.776446 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.776618 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.776785 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.776941 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.777098 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.777264 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.777412 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.777567 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.777715 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.777899 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.778588 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.778748 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.778904 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.779066 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.779221 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.779221 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.779534 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.779700 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.779872 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.780034 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.780198 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.780361 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.780515 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.780750 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.780917 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.781079 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.781240 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.781481 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.781646 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.781801 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.782191 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.782363 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.782533 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.782695 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.782851 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.783011 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.783173 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.783334 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.783497 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.783661 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.783824 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.783979 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.784133 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.784394 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.784573 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.784846 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.785003 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.785158 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.785310 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.785464 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.785630 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.785786 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.785942 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.786095 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.786095 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.786409 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.786576 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.786729 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.786882 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.787043 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.787203 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.787377 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.787532 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.787693 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.787855 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.787855 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.788154 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.788318 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.788480 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.788701 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.788861 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.789016 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.789180 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.789180 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.789180 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.789180 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.789830 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.789990 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.790177 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.790335 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.790489 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.790649 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.790821 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.790983 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.791153 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.791306 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.791466 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.791626 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.791779 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.791931 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.792092 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.792247 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.792401 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.792560 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.792750 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.792915 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.793084 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.793239 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.793390 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.793588 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.793751 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.793904 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.794069 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.794230 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.794385 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.794537 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.794689 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.794866 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.794866 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.795174 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.795368 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.795368 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.795686 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.795849 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.795849 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.796149 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.796315 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.796469 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.796696 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.796696 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.797025 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.797185 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.797185 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.797477 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.797629 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.797629 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.797936 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.798125 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.798371 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.798627 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.798627 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.799139 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.799400 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.799695 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.799963 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.800220 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.800470 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.800655 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.800655 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.800977 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.801132 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.801291 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.801459 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.801615 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.801784 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.801946 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.802112 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.802272 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.802437 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.802598 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.802752 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.802910 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.803065 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.803226 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.803387 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.803548 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.803703 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.803868 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.804033 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.804205 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.804360 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.804732 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.805016 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.805288 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.805552 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.805823 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.806167 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.806426 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.806773 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.807032 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.807032 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.807598 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.807765 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.807931 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.808088 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.808253 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.808424 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.808424 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.808768 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.808926 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.809087 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.809276 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.809443 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.809443 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.810154 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.810411 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.810652 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.810818 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.810818 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.811146 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.811302 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.811302 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.811605 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.811757 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.811757 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.812047 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.812221 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.812575 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.812799 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.812967 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.813124 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.813284 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.813439 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.813605 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.813761 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.813920 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.814084 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.814247 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.814410 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.814591 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.814758 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.814758 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.815061 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.815215 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.815377 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.815543 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.815696 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.815888 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.816202 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.816202 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.816543 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.816734 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.816912 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.817073 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.817236 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.817400 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.817570 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.817725 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.817878 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.818032 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.818185 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.818346 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.818346 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.818653 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.818814 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.818991 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.818991 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.818991 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.819503 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.819663 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.819663 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.819954 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.820115 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.820115 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.820435 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.820681 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.820681 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.820997 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.821166 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.821166 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.821479 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.821636 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.821788 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.821949 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.822116 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.822277 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.822432 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.822600 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.822600 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.822902 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.823080 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.823244 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.823407 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.823562 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.823562 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.824486 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.824691 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.825381 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.825547 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.825711 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.825876 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.826040 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.826195 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.826361 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.826524 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.826769 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.826941 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.827097 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.827250 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.827403 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.827556 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.827723 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.827886 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.828048 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.828210 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.828376 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.828551 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.828780 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.828947 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.829103 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.829257 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.829410 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.829570 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.829738 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.829738 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.830033 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.830849 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.831033 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.831203 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.831387 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.831550 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.831706 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.831859 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.832014 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.832184 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.832340 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.832504 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.832693 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.832852 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.833014 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.833186 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.833365 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.833521 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.833682 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.833837 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.833837 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.834148 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.834374 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.834536 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.834699 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.834861 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.835054 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.835216 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.835379 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.835554 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.835711 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.835871 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.836040 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.836196 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.836357 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.836518 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.836751 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.836862 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.836967 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.837058 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.837153 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.837242 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.837336 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.837436 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.837513 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.837586 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.837666 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.837741 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.837820 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.837907 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.837982 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.838063 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.838142 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.838221 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.838300 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.838382 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.838456 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.838535 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.838617 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.838697 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.838770 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.838851 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.838926 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.839004 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.839079 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.839159 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.839241 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.839326 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.839401 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.839474 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.839553 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.839626 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.839711 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.839785 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.839864 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.839864 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.840011 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.840085 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.840169 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.840252 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.840332 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.840459 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.840459 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.841157 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.841246 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.841328 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.841407 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.841486 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.841558 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.841637 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.841718 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.841792 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.841862 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.841862 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.841992 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.842076 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.842150 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.842241 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.842241 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.842417 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.842528 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.842644 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.842743 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.842820 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.842916 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.843014 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.843090 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.843177 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.843250 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.843250 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.843388 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.843465 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.843538 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.843713 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.843829 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.843949 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.844062 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.844174 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.844174 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.844360 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.844456 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.844551 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.844669 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.844669 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.844841 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.844929 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.845013 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.845098 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.845182 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.845266 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.845364 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.845450 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.845538 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.845618 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.845703 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.845788 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.845885 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.845978 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.846070 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.846156 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.846248 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.846343 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.846429 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.846513 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.846596 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.846681 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.846765 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.846867 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.846955 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.847048 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.847140 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.847226 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.847310 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.847404 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.847490 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.847575 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.847659 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.847751 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.847844 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.847939 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.848025 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.848117 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.848209 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.848301 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.848460 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.848555 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.848707 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.848804 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.848899 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.848984 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.849116 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.849221 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.849432 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.849528 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.849770 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.849866 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.850096 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.850192 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.850422 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.850519 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.850753 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.850854 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.851086 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.851180 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.851421 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.851513 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.851738 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.851845 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.852059 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.852159 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.852379 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.852480 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.852721 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.852838 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.853045 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.853151 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.853612 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.853710 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.853936 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.854083 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.854236 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.854366 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.854557 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.854658 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.854880 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.854987 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.855188 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.855288 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.855502 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.855633 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.855806 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.855899 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.856153 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.856259 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.856468 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.856560 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.856817 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.856947 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.857138 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.857281 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.857454 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.857550 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.857774 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.857869 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.858089 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.858182 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.858410 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.858504 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.858722 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.858817 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.859072 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.859174 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.859379 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.859524 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.859693 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.859822 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.860000 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.860108 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.860307 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.860414 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.860651 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.860750 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.860976 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.861083 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.861289 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.861397 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.861601 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.861705 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.861914 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.862048 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.862219 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.862367 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.862523 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.862688 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.862846 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.863012 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.863156 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.863332 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.863480 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.863645 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.863795 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.864076 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.864220 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.864342 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.864462 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.864650 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.864745 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.864921 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.865055 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.865234 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.865367 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.865566 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.865669 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.865879 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.865974 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.866211 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.866306 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.866586 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.866694 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.866893 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.866987 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.867215 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.867310 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.867547 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.867653 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.867877 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.867978 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.868188 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.868292 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.868521 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.868637 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.868871 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.868966 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.869189 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.869283 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.869508 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.869611 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.869833 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.869928 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.870139 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.870233 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.870444 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.870540 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.870755 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.870849 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.871059 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.871159 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.871362 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.871458 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.871689 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.871784 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.872000 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.872084 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.872304 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.872399 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.872628 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.872726 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.872930 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.873037 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.873258 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.873462 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.873564 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.873795 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.873888 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.874191 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.874335 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.874469 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.874611 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.874760 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.874861 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.875064 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.875196 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.875375 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.875478 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.875694 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.875800 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.876007 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.876101 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.876323 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.876416 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.876679 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.876793 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.876998 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.877094 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.877309 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.877401 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.877628 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.877771 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.877946 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.878065 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.878256 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.878358 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.878568 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.878670 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.878884 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.878978 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.879197 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.879293 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.879509 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.879610 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.879823 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.879931 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.880132 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.880227 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.880447 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.880548 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.880784 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.880891 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.881103 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.881197 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.881430 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.881659 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.881761 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.881988 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.882091 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.882304 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.882413 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.882620 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.882714 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.882933 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.883027 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.883252 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.883348 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.883565 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.883667 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.883878 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.883981 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.884313 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.884459 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.884614 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.884707 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.884806 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.884903 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.885138 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.885288 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.885460 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.885556 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.885786 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.885881 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.886120 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.886215 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.886435 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.886537 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.886749 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.886852 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.887059 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.887150 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.887898 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.887995 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.888211 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.888312 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.888530 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.888673 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.888867 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.888970 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.889180 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.889282 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.889490 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.889592 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.889806 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.889906 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.890121 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.890224 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.890433 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.890528 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.890751 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.890854 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.891064 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.891157 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.891375 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.891475 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.891684 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.891777 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.891997 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.892098 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.892312 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.892406 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.892658 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.892769 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.892994 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.893097 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.893315 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.893408 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.893636 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.893739 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.893952 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.894053 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.894266 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.894546 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.894670 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.894839 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.894936 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.895159 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.895261 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.895491 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.895597 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.895817 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.895912 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.896142 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.896235 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.896458 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.896563 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.896801 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.896903 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.897126 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.897221 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.897434 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.897535 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.897741 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.897844 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.898054 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.898303 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.898398 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.898641 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.898749 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.898967 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.899061 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.899277 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.899383 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.899582 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.899683 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.899903 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.899996 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.900214 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.900383 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.900533 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.900769 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.900877 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.901123 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.901224 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.901441 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.901543 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.901771 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.901874 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.902101 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.902194 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.902421 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.902524 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.902732 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.902827 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.903612 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.903727 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.903926 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.904030 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.904236 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.904336 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.904663 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.904823 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.904917 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.904992 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.905173 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.905267 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.905482 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.905613 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.905794 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.905898 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.906106 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.906200 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.906412 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.906508 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.906724 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.906827 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.907028 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.907122 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.907354 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.907456 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.907660 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.907754 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.907968 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.908070 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.908273 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.908368 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.908603 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.908712 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.908908 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.909016 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.909214 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.909333 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.909518 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.909675 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.909824 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.910007 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.910134 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.910332 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.910427 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.910657 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.910758 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.910988 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.911120 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.911325 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.911516 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.911800 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.911917 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.912110 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.912245 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.912494 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.912782 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.912895 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.913114 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.913223 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.913423 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.913531 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.913739 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.913840 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.914059 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.914159 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.914375 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.914494 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.914699 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.914819 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.915024 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.915341 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.915562 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.915678 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.915979 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.916125 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.916296 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.916487 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.916652 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.916824 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.916984 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.917364 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.917532 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.917695 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.917883 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.918052 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.918235 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.918345 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.918563 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.918730 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.918887 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.918997 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.919208 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.919318 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.919645 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.919752 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.919859 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.919977 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.920173 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.920276 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.920488 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.920653 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.920825 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.920947 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.921143 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.921252 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.921455 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.921567 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.921780 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.921884 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.922076 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.922191 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.922387 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.922502 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.922697 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.922808 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.923004 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.923108 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.923315 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.923432 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.923628 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.923752 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.923937 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.924050 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.924251 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.924356 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.924562 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.924724 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.925169 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.925271 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.925360 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.925456 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.925553 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.925651 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.925925 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.926025 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.926124 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.926213 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.926408 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.926536 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.926719 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.926818 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.927026 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.927142 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.927335 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.927430 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.927655 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.927750 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.927965 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.928057 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.928268 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.928364 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.928647 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.928763 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.928980 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.929122 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.929292 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.929394 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.929603 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.929705 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.929927 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.930032 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.930246 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.930338 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.930565 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.930660 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.930876 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.931052 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.931182 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.931275 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.931497 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.931589 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.931829 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.931976 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.932170 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.932370 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.932498 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.932740 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.940026 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.940143 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.940229 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.940317 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.940403 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.940488 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.940603 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.940694 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.940781 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.940866 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.940950 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.940950 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.941186 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.941280 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.941375 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.941462 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.941546 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.941639 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.941734 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.941821 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.941913 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.942005 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.942092 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.942186 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.942274 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.942366 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.942456 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.942549 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.942642 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.942742 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.942836 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.942922 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.943013 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.943100 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.943192 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.943299 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.943387 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.943472 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.943564 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.943650 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.943748 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.943835 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.943920 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.944011 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.944097 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.944191 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.944285 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.944372 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.944372 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.944525 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.944637 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.944769 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.944877 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.944975 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.945076 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.945160 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.945233 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.945315 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.945398 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.945480 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.945573 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.945660 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.945746 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.945844 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.945931 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.946165 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.946324 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.946420 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.946563 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.946711 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.946803 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.946942 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.947038 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.947133 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.947221 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.947315 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.947409 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.947485 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.947575 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.947669 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.947764 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.947850 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.947940 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.948032 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.948120 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.948205 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.948297 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.948383 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.948467 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.948552 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.948672 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.948763 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.948862 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.948956 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.949048 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.949134 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.949219 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.949315 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.949409 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.949502 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.949594 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.949686 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.950291 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.950389 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.950465 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.950538 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.950617 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.950703 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.950791 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.950885 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.950973 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.951065 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.951158 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.951251 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.951344 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.951442 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.951537 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.951630 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.951723 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.951816 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.951911 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.952047 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.952169 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.952365 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.952471 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.952703 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.952817 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.953018 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.953112 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.953331 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.953426 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.953645 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.953749 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.953961 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.954054 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.954273 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.954367 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.954585 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.954689 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.954900 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.955002 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.955211 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.955363 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.955496 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 05 13:00:11.955598 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.955819 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.956133 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.956442 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.956809 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.957152 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.957474 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.957806 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.958125 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.958455 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.958776 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.959107 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.959438 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.959762 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.960083 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.960426 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.960773 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.961097 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.961416 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.961736 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.962056 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.962378 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.962695 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.963038 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.963355 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.963691 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.964025 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.964357 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.964710 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.965034 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.965403 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.966389 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.966618 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.966948 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.967270 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.967593 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.967921 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.968251 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.968641 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.968952 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.969281 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.969607 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.969943 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.970310 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.970638 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.970997 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.971349 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.971664 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.971985 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.972414 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 13:00:11.972555 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 05 13:00:12.108433 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO dbcounter [None req-78cecab7-0c7f-4e21-9bb9-cc25d86cea54 None None] Registered counter for database nova_api Jul 05 13:00:12.126612 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO dbcounter [None req-7e8446f0-cfbd-451c-8dc0-66f5fdcb5eaa None None] Registered counter for database nova_api Jul 05 13:00:12.134734 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_db.sqlalchemy.engines [None req-78cecab7-0c7f-4e21-9bb9-cc25d86cea54 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118386) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 13:00:12.143425 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writer thread running {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 13:00:12.149079 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_db.sqlalchemy.engines [None req-7e8446f0-cfbd-451c-8dc0-66f5fdcb5eaa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118387) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 13:00:12.156171 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writer thread running {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 13:00:12.202236 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.context [None req-78cecab7-0c7f-4e21-9bb9-cc25d86cea54 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1f103960-fac2-43f5-a4e1-1a426049bf0c(cell1) {{(pid=118386) load_cells /opt/stack/nova/nova/context.py:464}} Jul 05 13:00:12.206355 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-78cecab7-0c7f-4e21-9bb9-cc25d86cea54 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:00:12.208176 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-78cecab7-0c7f-4e21-9bb9-cc25d86cea54 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:00:12.209072 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-78cecab7-0c7f-4e21-9bb9-cc25d86cea54 None None] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:00:12.211109 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-78cecab7-0c7f-4e21-9bb9-cc25d86cea54 None None] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:00:12.213139 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO dbcounter [None req-78cecab7-0c7f-4e21-9bb9-cc25d86cea54 None None] Registered counter for database nova_cell0 Jul 05 13:00:12.213437 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.context [None req-7e8446f0-cfbd-451c-8dc0-66f5fdcb5eaa None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1f103960-fac2-43f5-a4e1-1a426049bf0c(cell1) {{(pid=118387) load_cells /opt/stack/nova/nova/context.py:464}} Jul 05 13:00:12.217279 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO dbcounter [None req-78cecab7-0c7f-4e21-9bb9-cc25d86cea54 None None] Registered counter for database nova_cell1 Jul 05 13:00:12.217434 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7e8446f0-cfbd-451c-8dc0-66f5fdcb5eaa None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:00:12.219051 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7e8446f0-cfbd-451c-8dc0-66f5fdcb5eaa None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:00:12.219875 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7e8446f0-cfbd-451c-8dc0-66f5fdcb5eaa None None] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:00:12.221870 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7e8446f0-cfbd-451c-8dc0-66f5fdcb5eaa None None] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:00:12.223888 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO dbcounter [None req-7e8446f0-cfbd-451c-8dc0-66f5fdcb5eaa None None] Registered counter for database nova_cell0 Jul 05 13:00:12.224662 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_db.sqlalchemy.engines [None req-78cecab7-0c7f-4e21-9bb9-cc25d86cea54 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118386) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 13:00:12.226964 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_db.sqlalchemy.engines [None req-78cecab7-0c7f-4e21-9bb9-cc25d86cea54 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118386) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 13:00:12.228099 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO dbcounter [None req-7e8446f0-cfbd-451c-8dc0-66f5fdcb5eaa None None] Registered counter for database nova_cell1 Jul 05 13:00:12.235507 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_db.sqlalchemy.engines [None req-7e8446f0-cfbd-451c-8dc0-66f5fdcb5eaa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118387) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 13:00:12.237794 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_db.sqlalchemy.engines [None req-7e8446f0-cfbd-451c-8dc0-66f5fdcb5eaa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118387) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 13:00:12.239851 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writer thread running {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 13:00:12.241258 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writer thread running {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 13:00:12.242928 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writer thread running {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 13:00:12.245635 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writer thread running {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 13:00:12.388704 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO dbcounter [None req-78cecab7-0c7f-4e21-9bb9-cc25d86cea54 None None] Registered counter for database nova_cell0 Jul 05 13:00:12.393078 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO dbcounter [None req-7e8446f0-cfbd-451c-8dc0-66f5fdcb5eaa None None] Registered counter for database nova_cell0 Jul 05 13:00:12.395409 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_db.sqlalchemy.engines [None req-78cecab7-0c7f-4e21-9bb9-cc25d86cea54 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118386) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 13:00:12.399947 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_db.sqlalchemy.engines [None req-7e8446f0-cfbd-451c-8dc0-66f5fdcb5eaa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118387) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 13:00:12.400381 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writer thread running {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 13:00:12.404894 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writer thread running {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 13:00:12.720748 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: WARNING keystonemiddleware.auth_token [None req-78cecab7-0c7f-4e21-9bb9-cc25d86cea54 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 05 13:00:12.728101 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: WARNING keystonemiddleware.auth_token [None req-78cecab7-0c7f-4e21-9bb9-cc25d86cea54 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 05 13:00:12.729897 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: WARNING keystonemiddleware.auth_token [None req-7e8446f0-cfbd-451c-8dc0-66f5fdcb5eaa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 05 13:00:12.737851 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: WARNING keystonemiddleware.auth_token [None req-7e8446f0-cfbd-451c-8dc0-66f5fdcb5eaa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 05 13:00:13.073140 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: WARNING keystonemiddleware.auth_token [None req-78cecab7-0c7f-4e21-9bb9-cc25d86cea54 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 05 13:00:13.079157 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: WARNING keystonemiddleware.auth_token [None req-78cecab7-0c7f-4e21-9bb9-cc25d86cea54 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 05 13:00:13.084382 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bbf9fb29c0 pid: 118386 (default app) Jul 05 13:00:13.087922 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: WARNING keystonemiddleware.auth_token [None req-7e8446f0-cfbd-451c-8dc0-66f5fdcb5eaa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 05 13:00:13.094454 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: WARNING keystonemiddleware.auth_token [None req-7e8446f0-cfbd-451c-8dc0-66f5fdcb5eaa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 05 13:00:13.099710 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bbf9fb29c0 pid: 118387 (default app) Jul 05 13:00:54.161199 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_api:SELECT=3 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:00:54.161999 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_cell1:SELECT=3 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:00:54.162718 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_cell0:SELECT=3 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:00:54.163449 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_cell0:SELECT=3 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:00:55.278929 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-cf770ec9-b9d5-41fa-8fbd-a91a95182c6b tempest-VolumesSnapshotsTestJSON-1504263392 tempest-VolumesSnapshotsTestJSON-1504263392-project] Action: 'create', calling method: .version_select at 0x7f70e06275e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-334633127"}} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:00:55.655433 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_api:SELECT=3 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:00:55.655433 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell1:SELECT=3 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:00:55.655433 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell0:SELECT=3 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:00:55.656497 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell0:SELECT=3 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:00:56.980211 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-4d3c030e-bd94-49ac-a7d8-7326c207b95e tempest-VolumesGetTestJSON-1525341292 tempest-VolumesGetTestJSON-1525341292-project] Action: 'create', calling method: .version_select at 0x7f70e0627550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-711346558", "metadata": {"Type": "work"}}} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:00:57.492863 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-cf770ec9-b9d5-41fa-8fbd-a91a95182c6b tempest-VolumesSnapshotsTestJSON-1504263392 tempest-VolumesSnapshotsTestJSON-1504263392-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.346323 Jul 05 13:00:57.494617 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 1/1] 10.222.0.36 () {60 vars in 1154 bytes} [Tue Jul 5 13:00:54 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3350 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 05 13:00:57.508388 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-62f3850f-c611-4bf4-91b5-c777b2484e6b tempest-VolumesSnapshotsTestJSON-1504263392 tempest-VolumesSnapshotsTestJSON-1504263392-project] Calling method '.version_select at 0x7f70e04ec4c0>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:00:57.634194 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-62f3850f-c611-4bf4-91b5-c777b2484e6b tempest-VolumesSnapshotsTestJSON-1504263392 tempest-VolumesSnapshotsTestJSON-1504263392-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/8a78df38-c4d5-427f-959c-ec9b4d89a37b" status: 200 len: 344 microversion: 2.1 time: 0.131099 Jul 05 13:00:57.635317 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 2/2] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Jul 5 13:00:57 2022] GET /compute/v2.1/os-volumes/8a78df38-c4d5-427f-959c-ec9b4d89a37b => generated 344 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:00:58.647228 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-1655406c-92f2-4703-874d-43094da42a19 tempest-VolumesSnapshotsTestJSON-1504263392 tempest-VolumesSnapshotsTestJSON-1504263392-project] Calling method '.version_select at 0x7f70e04ec5e0>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:00:58.766878 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-1655406c-92f2-4703-874d-43094da42a19 tempest-VolumesSnapshotsTestJSON-1504263392 tempest-VolumesSnapshotsTestJSON-1504263392-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/8a78df38-c4d5-427f-959c-ec9b4d89a37b" status: 200 len: 345 microversion: 2.1 time: 0.123759 Jul 05 13:00:58.767671 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 3/3] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Jul 5 13:00:58 2022] GET /compute/v2.1/os-volumes/8a78df38-c4d5-427f-959c-ec9b4d89a37b => generated 345 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:00:58.779084 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-5f381dfb-13db-4276-a539-5bc20a4c2d33 tempest-VolumesSnapshotsTestJSON-1504263392 tempest-VolumesSnapshotsTestJSON-1504263392-project] Action: 'create', calling method: .version_select at 0x7f70e04ecb80>, body: {"snapshot": {"volume_id": "8a78df38-c4d5-427f-959c-ec9b4d89a37b", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-944535233"}} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:00:58.846947 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-4d3c030e-bd94-49ac-a7d8-7326c207b95e tempest-VolumesGetTestJSON-1525341292 tempest-VolumesGetTestJSON-1525341292-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.200696 Jul 05 13:00:58.847993 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 1/4] 10.222.0.36 () {60 vars in 1155 bytes} [Tue Jul 5 13:00:55 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3206 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 05 13:00:58.861847 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-7aef3aa9-da77-41af-bc2e-e2f84c1e426f tempest-VolumesGetTestJSON-1525341292 tempest-VolumesGetTestJSON-1525341292-project] Calling method '.version_select at 0x7f70e04ee430>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:00:59.035950 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-7aef3aa9-da77-41af-bc2e-e2f84c1e426f tempest-VolumesGetTestJSON-1525341292 tempest-VolumesGetTestJSON-1525341292-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/c7727d2a-ecd4-47b8-b13b-f9a238976cc4" status: 200 len: 352 microversion: 2.1 time: 0.179260 Jul 05 13:00:59.036854 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 2/5] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Jul 5 13:00:58 2022] GET /compute/v2.1/os-volumes/c7727d2a-ecd4-47b8-b13b-f9a238976cc4 => generated 352 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 13:00:59.743470 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-5f381dfb-13db-4276-a539-5bc20a4c2d33 tempest-VolumesSnapshotsTestJSON-1504263392 tempest-VolumesSnapshotsTestJSON-1504263392-project] 10.222.0.36 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.966458 Jul 05 13:00:59.743470 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 4/6] 10.222.0.36 () {60 vars in 1161 bytes} [Tue Jul 5 13:00:58 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:00:59.768972 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-b127a984-8727-4478-a411-2b274cecd223 tempest-VolumesSnapshotsTestJSON-1504263392 tempest-VolumesSnapshotsTestJSON-1504263392-project] Calling method '.version_select at 0x7f70e04ee790>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:00:59.937193 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-b127a984-8727-4478-a411-2b274cecd223 tempest-VolumesSnapshotsTestJSON-1504263392 tempest-VolumesSnapshotsTestJSON-1504263392-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/3bd8e22c-a03c-4ef9-93cc-41d41d9a461e" status: 200 len: 286 microversion: 2.1 time: 0.185751 Jul 05 13:00:59.946379 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 3/7] 10.222.0.36 () {58 vars in 1250 bytes} [Tue Jul 5 13:00:59 2022] GET /compute/v2.1/os-snapshots/3bd8e22c-a03c-4ef9-93cc-41d41d9a461e => generated 286 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:00:59.949234 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-8184ab78-bdf8-40c8-b976-0588634f39fb tempest-VolumesSnapshotsTestJSON-1504263392 tempest-VolumesSnapshotsTestJSON-1504263392-project] Calling method '.version_select at 0x7f70e0506790>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:00.069249 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-96e5ad2c-1ebe-4da4-8988-9a91b516edf5 tempest-VolumesGetTestJSON-1525341292 tempest-VolumesGetTestJSON-1525341292-project] Calling method '.version_select at 0x7f70e04eec10>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:00.111977 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-8184ab78-bdf8-40c8-b976-0588634f39fb tempest-VolumesSnapshotsTestJSON-1504263392 tempest-VolumesSnapshotsTestJSON-1504263392-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.166715 Jul 05 13:01:00.119771 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 5/8] 10.222.0.36 () {58 vars in 1139 bytes} [Tue Jul 5 13:00:59 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:01:00.123725 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-aa0943e3-a3f3-419d-903e-2d97cc800ab4 tempest-VolumesSnapshotsTestJSON-1504263392 tempest-VolumesSnapshotsTestJSON-1504263392-project] Calling method '.version_select at 0x7f70e0506820>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:00.177192 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-aa0943e3-a3f3-419d-903e-2d97cc800ab4 tempest-VolumesSnapshotsTestJSON-1504263392 tempest-VolumesSnapshotsTestJSON-1504263392-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/3bd8e22c-a03c-4ef9-93cc-41d41d9a461e" status: 200 len: 286 microversion: 2.1 time: 0.057859 Jul 05 13:01:00.177751 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 6/9] 10.222.0.36 () {58 vars in 1250 bytes} [Tue Jul 5 13:01:00 2022] GET /compute/v2.1/os-snapshots/3bd8e22c-a03c-4ef9-93cc-41d41d9a461e => generated 286 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 13:01:00.178019 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-96e5ad2c-1ebe-4da4-8988-9a91b516edf5 tempest-VolumesGetTestJSON-1525341292 tempest-VolumesGetTestJSON-1525341292-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/c7727d2a-ecd4-47b8-b13b-f9a238976cc4" status: 200 len: 353 microversion: 2.1 time: 0.133375 Jul 05 13:01:00.178596 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 4/10] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Jul 5 13:01:00 2022] GET /compute/v2.1/os-volumes/c7727d2a-ecd4-47b8-b13b-f9a238976cc4 => generated 353 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 13:01:00.193344 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-ca501a8b-ff9b-495a-a2a7-7f82de9acb99 tempest-VolumesGetTestJSON-1525341292 tempest-VolumesGetTestJSON-1525341292-project] Calling method '.version_select at 0x7f70e0506040>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:00.280052 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-ca501a8b-ff9b-495a-a2a7-7f82de9acb99 tempest-VolumesGetTestJSON-1525341292 tempest-VolumesGetTestJSON-1525341292-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/c7727d2a-ecd4-47b8-b13b-f9a238976cc4" status: 200 len: 353 microversion: 2.1 time: 0.092469 Jul 05 13:01:00.282043 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 7/11] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Jul 5 13:01:00 2022] GET /compute/v2.1/os-volumes/c7727d2a-ecd4-47b8-b13b-f9a238976cc4 => generated 353 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:01:00.297982 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-3ae9e628-cfe1-43b6-a3bd-097cd4a2d6b2 tempest-VolumesGetTestJSON-1525341292 tempest-VolumesGetTestJSON-1525341292-project] Calling method '.version_select at 0x7f70e0508310>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:00.672508 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-3ae9e628-cfe1-43b6-a3bd-097cd4a2d6b2 tempest-VolumesGetTestJSON-1525341292 tempest-VolumesGetTestJSON-1525341292-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/c7727d2a-ecd4-47b8-b13b-f9a238976cc4" status: 202 len: 0 microversion: 2.1 time: 0.364976 Jul 05 13:01:00.672508 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 5/12] 10.222.0.36 () {58 vars in 1247 bytes} [Tue Jul 5 13:01:00 2022] DELETE /compute/v2.1/os-volumes/c7727d2a-ecd4-47b8-b13b-f9a238976cc4 => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 13:01:00.681014 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-a4ae14a3-8b3d-423e-a04b-65bc747a433e tempest-VolumesGetTestJSON-1525341292 tempest-VolumesGetTestJSON-1525341292-project] Calling method '.version_select at 0x7f70e04ecee0>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:00.773828 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-a4ae14a3-8b3d-423e-a04b-65bc747a433e tempest-VolumesGetTestJSON-1525341292 tempest-VolumesGetTestJSON-1525341292-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/c7727d2a-ecd4-47b8-b13b-f9a238976cc4" status: 200 len: 352 microversion: 2.1 time: 0.100065 Jul 05 13:01:00.775313 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 8/13] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Jul 5 13:01:00 2022] GET /compute/v2.1/os-volumes/c7727d2a-ecd4-47b8-b13b-f9a238976cc4 => generated 352 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:01:01.188932 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-9c38dd26-d17e-409e-8716-974d321548d6 tempest-VolumesSnapshotsTestJSON-1504263392 tempest-VolumesSnapshotsTestJSON-1504263392-project] Calling method '.version_select at 0x7f70e04eedc0>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:01.221794 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-9c38dd26-d17e-409e-8716-974d321548d6 tempest-VolumesSnapshotsTestJSON-1504263392 tempest-VolumesSnapshotsTestJSON-1504263392-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/3bd8e22c-a03c-4ef9-93cc-41d41d9a461e" status: 200 len: 286 microversion: 2.1 time: 0.036510 Jul 05 13:01:01.222404 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 6/14] 10.222.0.36 () {58 vars in 1250 bytes} [Tue Jul 5 13:01:01 2022] GET /compute/v2.1/os-snapshots/3bd8e22c-a03c-4ef9-93cc-41d41d9a461e => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:01:01.785922 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-a08a3811-83c1-4c75-86b6-ae8b1c899a95 tempest-VolumesGetTestJSON-1525341292 tempest-VolumesGetTestJSON-1525341292-project] Calling method '.version_select at 0x7f70e0506d30>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:01.915694 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-a08a3811-83c1-4c75-86b6-ae8b1c899a95 tempest-VolumesGetTestJSON-1525341292 tempest-VolumesGetTestJSON-1525341292-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/c7727d2a-ecd4-47b8-b13b-f9a238976cc4" status: 200 len: 352 microversion: 2.1 time: 0.132752 Jul 05 13:01:01.916542 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 9/15] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Jul 5 13:01:01 2022] GET /compute/v2.1/os-volumes/c7727d2a-ecd4-47b8-b13b-f9a238976cc4 => generated 352 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:01:02.234959 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-27a1a9aa-fa17-4bd5-89c4-f3fcd74fd106 tempest-VolumesSnapshotsTestJSON-1504263392 tempest-VolumesSnapshotsTestJSON-1504263392-project] Calling method '.version_select at 0x7f70e04ee670>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:02.370205 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-27a1a9aa-fa17-4bd5-89c4-f3fcd74fd106 tempest-VolumesSnapshotsTestJSON-1504263392 tempest-VolumesSnapshotsTestJSON-1504263392-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/3bd8e22c-a03c-4ef9-93cc-41d41d9a461e" status: 200 len: 286 microversion: 2.1 time: 0.139121 Jul 05 13:01:02.371044 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 7/16] 10.222.0.36 () {58 vars in 1250 bytes} [Tue Jul 5 13:01:02 2022] GET /compute/v2.1/os-snapshots/3bd8e22c-a03c-4ef9-93cc-41d41d9a461e => generated 286 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:01:02.927055 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-9bff9261-780b-461d-b2f7-31f4f6b589ca tempest-VolumesGetTestJSON-1525341292 tempest-VolumesGetTestJSON-1525341292-project] Calling method '.version_select at 0x7f70e05064c0>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:03.040839 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-9bff9261-780b-461d-b2f7-31f4f6b589ca tempest-VolumesGetTestJSON-1525341292 tempest-VolumesGetTestJSON-1525341292-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/c7727d2a-ecd4-47b8-b13b-f9a238976cc4" status: 200 len: 352 microversion: 2.1 time: 0.117353 Jul 05 13:01:03.041425 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 10/17] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Jul 5 13:01:02 2022] GET /compute/v2.1/os-volumes/c7727d2a-ecd4-47b8-b13b-f9a238976cc4 => generated 352 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:01:03.385103 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-c76f663d-a5fa-4356-be51-934c6f1089f4 tempest-VolumesSnapshotsTestJSON-1504263392 tempest-VolumesSnapshotsTestJSON-1504263392-project] Calling method '.version_select at 0x7f70e05085e0>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:03.453644 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-c76f663d-a5fa-4356-be51-934c6f1089f4 tempest-VolumesSnapshotsTestJSON-1504263392 tempest-VolumesSnapshotsTestJSON-1504263392-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/3bd8e22c-a03c-4ef9-93cc-41d41d9a461e" status: 200 len: 286 microversion: 2.1 time: 0.074738 Jul 05 13:01:03.453644 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 8/18] 10.222.0.36 () {58 vars in 1250 bytes} [Tue Jul 5 13:01:03 2022] GET /compute/v2.1/os-snapshots/3bd8e22c-a03c-4ef9-93cc-41d41d9a461e => generated 286 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:01:04.055069 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-33baee8f-37c4-4d5f-941b-1fa387ffc6c0 tempest-VolumesGetTestJSON-1525341292 tempest-VolumesGetTestJSON-1525341292-project] Calling method '.version_select at 0x7f70e04ec3a0>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:04.107644 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.wsgi [None req-33baee8f-37c4-4d5f-941b-1fa387ffc6c0 tempest-VolumesGetTestJSON-1525341292 tempest-VolumesGetTestJSON-1525341292-project] HTTP exception thrown: Volume c7727d2a-ecd4-47b8-b13b-f9a238976cc4 could not be found. Jul 05 13:01:04.119030 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-33baee8f-37c4-4d5f-941b-1fa387ffc6c0 tempest-VolumesGetTestJSON-1525341292 tempest-VolumesGetTestJSON-1525341292-project] Request method failure captured: Jul 05 13:01:04.119030 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: request: GET /compute/v2.1/os-volumes/c7727d2a-ecd4-47b8-b13b-f9a238976cc4 HTTP/1.1 Jul 05 13:01:04.119030 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Accept: application/json Jul 05 13:01:04.119030 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Accept-Encoding: identity Jul 05 13:01:04.119030 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Connection: close Jul 05 13:01:04.119030 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Content-Length: 0 Jul 05 13:01:04.119030 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Content-Type: application/json Jul 05 13:01:04.119030 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Host: 10.222.0.36 Jul 05 13:01:04.119030 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Openstack-System-Scope: None Jul 05 13:01:04.119030 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: User-Agent: python-urllib3/1.26.9 Jul 05 13:01:04.119030 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Auth-Token: gAAAAABixDYHkiYYUu2d0Y68WLq7t-1NJ_S1o5B8iwlultFZUDW_fMSpzT08HsoF-SXAhIwfLGSpdhmqt2WtA-FyBJFDfhA04ZGHC55kPDzeEJ4MNPIJ4skG6cu5B4rnm7jAc2YqTpNOErhAvFytp20wAsWHmEE1nFfQ6Cai8Cv8GkjiY5X6xLc Jul 05 13:01:04.119030 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Domain-Id: None Jul 05 13:01:04.119030 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Domain-Name: None Jul 05 13:01:04.119030 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Identity-Status: Confirmed Jul 05 13:01:04.119030 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Is-Admin-Project: True Jul 05 13:01:04.119030 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Domain-Id: default Jul 05 13:01:04.119030 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Domain-Name: Default Jul 05 13:01:04.119030 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Id: 6e6d3f1f098d4520b1eec489c92e2ebd Jul 05 13:01:04.119030 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Name: tempest-VolumesGetTestJSON-1525341292 Jul 05 13:01:04.119030 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Role: member,reader Jul 05 13:01:04.119030 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Roles: member,reader Jul 05 13:01:04.120250 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6e6d3f1f098d4520b1eec489c92e2ebd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6e6d3f1f098d4520b1eec489c92e2ebd", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6e6d3f1f098d4520b1eec489c92e2ebd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6e6d3f1f098d4520b1eec489c92e2ebd"}]}] Jul 05 13:01:04.120250 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Tenant: tempest-VolumesGetTestJSON-1525341292 Jul 05 13:01:04.120250 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Tenant-Id: 6e6d3f1f098d4520b1eec489c92e2ebd Jul 05 13:01:04.120250 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Tenant-Name: tempest-VolumesGetTestJSON-1525341292 Jul 05 13:01:04.120250 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User: tempest-VolumesGetTestJSON-1525341292-project Jul 05 13:01:04.120250 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Domain-Id: default Jul 05 13:01:04.120250 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Domain-Name: Default Jul 05 13:01:04.120250 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Id: 6fb634208b9b4c57b6d0d3c01b1e5906 Jul 05 13:01:04.120250 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Name: tempest-VolumesGetTestJSON-1525341292-project Jul 05 13:01:04.120250 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: method: Jul 05 13:01:04.120250 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: exception: Volume c7727d2a-ecd4-47b8-b13b-f9a238976cc4 could not be found. Jul 05 13:01:04.120250 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: action_args: {'id': 'c7727d2a-ecd4-47b8-b13b-f9a238976cc4'} Jul 05 13:01:04.120250 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 13:01:04.120979 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:01:04.120979 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 05 13:01:04.120979 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 05 13:01:04.120979 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 05 13:01:04.120979 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 05 13:01:04.120979 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 05 13:01:04.120979 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 05 13:01:04.120979 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 05 13:01:04.120979 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 05 13:01:04.120979 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 05 13:01:04.120979 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 05 13:01:04.120979 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 05 13:01:04.120979 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 05 13:01:04.120979 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 05 13:01:04.120979 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 05 13:01:04.120979 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c7727d2a-ecd4-47b8-b13b-f9a238976cc4 could not be found. (HTTP 404) (Request-ID: req-e67b6635-7816-4412-9dfb-f7279edde1da) Jul 05 13:01:04.120979 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:01:04.120979 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:01:04.120979 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:01:04.121920 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:01:04.121920 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 05 13:01:04.121920 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 05 13:01:04.121920 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 05 13:01:04.121920 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 05 13:01:04.121920 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 05 13:01:04.121920 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 05 13:01:04.121920 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 05 13:01:04.121920 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 05 13:01:04.121920 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 05 13:01:04.121920 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 05 13:01:04.121920 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 05 13:01:04.121920 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 05 13:01:04.121920 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 05 13:01:04.121920 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 05 13:01:04.121920 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 05 13:01:04.121920 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 05 13:01:04.121920 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 05 13:01:04.121920 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 05 13:01:04.124331 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 05 13:01:04.124331 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 05 13:01:04.124331 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 05 13:01:04.124331 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 05 13:01:04.124331 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c7727d2a-ecd4-47b8-b13b-f9a238976cc4 could not be found. Jul 05 13:01:04.124331 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:01:04.124331 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:01:04.124331 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:01:04.124331 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:01:04.124331 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:01:04.124331 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:01:04.124331 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 13:01:04.124331 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 13:01:04.124331 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 05 13:01:04.124331 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 05 13:01:04.124331 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 13:01:04.124331 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 13:01:04.124331 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 05 13:01:04.124331 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 13:01:04.126414 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c7727d2a-ecd4-47b8-b13b-f9a238976cc4 could not be found. Jul 05 13:01:04.126414 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:01:04.126414 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:01:04.126414 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:01:04.126414 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:01:04.126414 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:01:04.126414 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:01:04.126414 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 13:01:04.126414 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 13:01:04.126414 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c7727d2a-ecd4-47b8-b13b-f9a238976cc4 could not be found. Jul 05 13:01:04.126414 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:01:04.126414 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-33baee8f-37c4-4d5f-941b-1fa387ffc6c0 tempest-VolumesGetTestJSON-1525341292 tempest-VolumesGetTestJSON-1525341292-project] Returning 404 to user: Volume c7727d2a-ecd4-47b8-b13b-f9a238976cc4 could not be found. {{(pid=118386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 13:01:04.128766 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-33baee8f-37c4-4d5f-941b-1fa387ffc6c0 tempest-VolumesGetTestJSON-1525341292 tempest-VolumesGetTestJSON-1525341292-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/c7727d2a-ecd4-47b8-b13b-f9a238976cc4" status: 404 len: 109 microversion: 2.1 time: 0.070858 Jul 05 13:01:04.129638 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 11/19] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Jul 5 13:01:04 2022] GET /compute/v2.1/os-volumes/c7727d2a-ecd4-47b8-b13b-f9a238976cc4 => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 13:01:04.466144 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-05fc3f77-f74a-4c98-9819-e967cf1e7863 tempest-VolumesSnapshotsTestJSON-1504263392 tempest-VolumesSnapshotsTestJSON-1504263392-project] Calling method '.version_select at 0x7f70e04ee9d0>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:04.516706 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-05fc3f77-f74a-4c98-9819-e967cf1e7863 tempest-VolumesSnapshotsTestJSON-1504263392 tempest-VolumesSnapshotsTestJSON-1504263392-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/3bd8e22c-a03c-4ef9-93cc-41d41d9a461e" status: 200 len: 287 microversion: 2.1 time: 0.055059 Jul 05 13:01:04.517412 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 9/20] 10.222.0.36 () {58 vars in 1250 bytes} [Tue Jul 5 13:01:04 2022] GET /compute/v2.1/os-snapshots/3bd8e22c-a03c-4ef9-93cc-41d41d9a461e => generated 287 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:01:04.528238 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-35b80738-a1dc-49a6-9e89-b416261d11c6 tempest-VolumesSnapshotsTestJSON-1504263392 tempest-VolumesSnapshotsTestJSON-1504263392-project] Calling method '.version_select at 0x7f70e04ec700>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:04.736197 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-35b80738-a1dc-49a6-9e89-b416261d11c6 tempest-VolumesSnapshotsTestJSON-1504263392 tempest-VolumesSnapshotsTestJSON-1504263392-project] 10.222.0.36 "DELETE /compute/v2.1/os-snapshots/3bd8e22c-a03c-4ef9-93cc-41d41d9a461e" status: 202 len: 0 microversion: 2.1 time: 0.212116 Jul 05 13:01:04.737073 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 12/21] 10.222.0.36 () {58 vars in 1253 bytes} [Tue Jul 5 13:01:04 2022] DELETE /compute/v2.1/os-snapshots/3bd8e22c-a03c-4ef9-93cc-41d41d9a461e => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 13:01:04.747557 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-da51cfcd-6a89-4011-9d28-9c15896d090d tempest-VolumesSnapshotsTestJSON-1504263392 tempest-VolumesSnapshotsTestJSON-1504263392-project] Calling method '.version_select at 0x7f70e04eeb80>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:04.807241 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-da51cfcd-6a89-4011-9d28-9c15896d090d tempest-VolumesSnapshotsTestJSON-1504263392 tempest-VolumesSnapshotsTestJSON-1504263392-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/3bd8e22c-a03c-4ef9-93cc-41d41d9a461e" status: 200 len: 286 microversion: 2.1 time: 0.065161 Jul 05 13:01:04.808103 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 10/22] 10.222.0.36 () {58 vars in 1250 bytes} [Tue Jul 5 13:01:04 2022] GET /compute/v2.1/os-snapshots/3bd8e22c-a03c-4ef9-93cc-41d41d9a461e => generated 286 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:01:05.818841 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-ff43acfb-76ee-4b25-a98c-6cb016f54e46 tempest-VolumesSnapshotsTestJSON-1504263392 tempest-VolumesSnapshotsTestJSON-1504263392-project] Calling method '.version_select at 0x7f70e0473310>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:05.893989 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.wsgi [None req-ff43acfb-76ee-4b25-a98c-6cb016f54e46 tempest-VolumesSnapshotsTestJSON-1504263392 tempest-VolumesSnapshotsTestJSON-1504263392-project] HTTP exception thrown: Snapshot 3bd8e22c-a03c-4ef9-93cc-41d41d9a461e could not be found. Jul 05 13:01:05.896429 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-ff43acfb-76ee-4b25-a98c-6cb016f54e46 tempest-VolumesSnapshotsTestJSON-1504263392 tempest-VolumesSnapshotsTestJSON-1504263392-project] Request method failure captured: Jul 05 13:01:05.896429 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: request: GET /compute/v2.1/os-snapshots/3bd8e22c-a03c-4ef9-93cc-41d41d9a461e HTTP/1.1 Jul 05 13:01:05.896429 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Accept: application/json Jul 05 13:01:05.896429 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Accept-Encoding: identity Jul 05 13:01:05.896429 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Connection: close Jul 05 13:01:05.896429 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Content-Length: 0 Jul 05 13:01:05.896429 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Content-Type: application/json Jul 05 13:01:05.896429 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Host: 10.222.0.36 Jul 05 13:01:05.896429 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Openstack-System-Scope: None Jul 05 13:01:05.896429 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: User-Agent: python-urllib3/1.26.9 Jul 05 13:01:05.896429 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Auth-Token: gAAAAABixDYGgEQBbHuNv1E9cMJ4yDZw6DZD9KekVIB9I5IPUeg1uukkikEnhoTjozXv-kmWgHyMxxjPOB0MgogOk3jY_WGxlRAWGmjrmpu4EAO78gfBsCm9jo1ni1HVFAdR6Vs08RRbnyDZVGmxoIivKYYlWtY09BGNA45oLhozrVlcuKKockk Jul 05 13:01:05.896429 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Domain-Id: None Jul 05 13:01:05.896429 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Domain-Name: None Jul 05 13:01:05.896429 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Identity-Status: Confirmed Jul 05 13:01:05.896429 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Is-Admin-Project: True Jul 05 13:01:05.896429 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Domain-Id: default Jul 05 13:01:05.896429 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Domain-Name: Default Jul 05 13:01:05.896429 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Id: cb21718b212946f4ae9d68290e43b46e Jul 05 13:01:05.896429 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1504263392 Jul 05 13:01:05.896429 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Role: member,reader Jul 05 13:01:05.896429 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Roles: member,reader Jul 05 13:01:05.897546 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/cb21718b212946f4ae9d68290e43b46e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_cb21718b212946f4ae9d68290e43b46e", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/cb21718b212946f4ae9d68290e43b46e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/cb21718b212946f4ae9d68290e43b46e"}]}] Jul 05 13:01:05.897546 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1504263392 Jul 05 13:01:05.897546 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Tenant-Id: cb21718b212946f4ae9d68290e43b46e Jul 05 13:01:05.897546 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1504263392 Jul 05 13:01:05.897546 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User: tempest-VolumesSnapshotsTestJSON-1504263392-project Jul 05 13:01:05.897546 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Domain-Id: default Jul 05 13:01:05.897546 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Domain-Name: Default Jul 05 13:01:05.897546 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Id: 1f36ee437cac4538b20aa06cabaacc59 Jul 05 13:01:05.897546 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1504263392-project Jul 05 13:01:05.897546 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: method: Jul 05 13:01:05.897546 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: exception: Snapshot 3bd8e22c-a03c-4ef9-93cc-41d41d9a461e could not be found. Jul 05 13:01:05.897546 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: action_args: {'id': '3bd8e22c-a03c-4ef9-93cc-41d41d9a461e'} Jul 05 13:01:05.897546 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 13:01:05.898251 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:01:05.898251 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 05 13:01:05.898251 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 05 13:01:05.898251 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 05 13:01:05.898251 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 05 13:01:05.898251 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 05 13:01:05.898251 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 05 13:01:05.898251 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 05 13:01:05.898251 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 05 13:01:05.898251 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 05 13:01:05.898251 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 05 13:01:05.898251 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 05 13:01:05.898251 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 05 13:01:05.898251 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 05 13:01:05.898251 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 05 13:01:05.898251 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 3bd8e22c-a03c-4ef9-93cc-41d41d9a461e could not be found. (HTTP 404) (Request-ID: req-65560fba-0bf3-4133-9a43-ec64f53fe64d) Jul 05 13:01:05.898251 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:01:05.898251 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:01:05.901068 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:01:05.901068 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:01:05.901068 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 05 13:01:05.901068 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 05 13:01:05.901068 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 05 13:01:05.901068 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 05 13:01:05.901068 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 05 13:01:05.901068 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 05 13:01:05.901068 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 05 13:01:05.901068 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 05 13:01:05.901068 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 05 13:01:05.901068 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 05 13:01:05.901068 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 05 13:01:05.901068 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 05 13:01:05.901068 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 05 13:01:05.901068 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 05 13:01:05.901068 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 05 13:01:05.901068 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 05 13:01:05.901068 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 05 13:01:05.902726 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 05 13:01:05.902726 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 05 13:01:05.902726 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 05 13:01:05.902726 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 05 13:01:05.902726 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 05 13:01:05.902726 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 3bd8e22c-a03c-4ef9-93cc-41d41d9a461e could not be found. Jul 05 13:01:05.902726 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:01:05.902726 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:01:05.902726 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:01:05.902726 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:01:05.902726 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:01:05.902726 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:01:05.902726 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 13:01:05.902726 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 13:01:05.902726 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 05 13:01:05.902726 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 05 13:01:05.902726 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 13:01:05.902726 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 13:01:05.902726 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 05 13:01:05.902726 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 13:01:05.905241 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 3bd8e22c-a03c-4ef9-93cc-41d41d9a461e could not be found. Jul 05 13:01:05.905241 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:01:05.905241 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:01:05.905241 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:01:05.905241 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:01:05.905241 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:01:05.905241 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:01:05.905241 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 13:01:05.905241 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 13:01:05.905241 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 3bd8e22c-a03c-4ef9-93cc-41d41d9a461e could not be found. Jul 05 13:01:05.905241 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:01:05.905241 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-ff43acfb-76ee-4b25-a98c-6cb016f54e46 tempest-VolumesSnapshotsTestJSON-1504263392 tempest-VolumesSnapshotsTestJSON-1504263392-project] Returning 404 to user: Snapshot 3bd8e22c-a03c-4ef9-93cc-41d41d9a461e could not be found. {{(pid=118386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 13:01:05.905241 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-ff43acfb-76ee-4b25-a98c-6cb016f54e46 tempest-VolumesSnapshotsTestJSON-1504263392 tempest-VolumesSnapshotsTestJSON-1504263392-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/3bd8e22c-a03c-4ef9-93cc-41d41d9a461e" status: 404 len: 111 microversion: 2.1 time: 0.082738 Jul 05 13:01:05.907206 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 13/23] 10.222.0.36 () {58 vars in 1250 bytes} [Tue Jul 5 13:01:05 2022] GET /compute/v2.1/os-snapshots/3bd8e22c-a03c-4ef9-93cc-41d41d9a461e => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 13:01:05.907548 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-03a73522-cf8b-4920-9667-06bb00ac6b56 tempest-VolumesSnapshotsTestJSON-1504263392 tempest-VolumesSnapshotsTestJSON-1504263392-project] Calling method '.version_select at 0x7f70e0508280>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:06.489238 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-03a73522-cf8b-4920-9667-06bb00ac6b56 tempest-VolumesSnapshotsTestJSON-1504263392 tempest-VolumesSnapshotsTestJSON-1504263392-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/8a78df38-c4d5-427f-959c-ec9b4d89a37b" status: 202 len: 0 microversion: 2.1 time: 0.585809 Jul 05 13:01:06.490044 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 11/24] 10.222.0.36 () {58 vars in 1247 bytes} [Tue Jul 5 13:01:05 2022] DELETE /compute/v2.1/os-volumes/8a78df38-c4d5-427f-959c-ec9b4d89a37b => generated 0 bytes in 587 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 05 13:01:06.498388 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-a79425a6-5917-46d6-b85e-850e3b2dcdf6 tempest-VolumesSnapshotsTestJSON-1504263392 tempest-VolumesSnapshotsTestJSON-1504263392-project] Calling method '.version_select at 0x7f70e0473280>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:06.631767 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-a79425a6-5917-46d6-b85e-850e3b2dcdf6 tempest-VolumesSnapshotsTestJSON-1504263392 tempest-VolumesSnapshotsTestJSON-1504263392-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/8a78df38-c4d5-427f-959c-ec9b4d89a37b" status: 200 len: 344 microversion: 2.1 time: 0.137378 Jul 05 13:01:06.632803 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 14/25] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Jul 5 13:01:06 2022] GET /compute/v2.1/os-volumes/8a78df38-c4d5-427f-959c-ec9b4d89a37b => generated 344 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:01:07.651726 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-c8f8e323-ecca-47e7-9cfb-36d74554ae5d tempest-VolumesSnapshotsTestJSON-1504263392 tempest-VolumesSnapshotsTestJSON-1504263392-project] Calling method '.version_select at 0x7f70e0508b80>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:08.034518 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.wsgi [None req-c8f8e323-ecca-47e7-9cfb-36d74554ae5d tempest-VolumesSnapshotsTestJSON-1504263392 tempest-VolumesSnapshotsTestJSON-1504263392-project] HTTP exception thrown: Volume 8a78df38-c4d5-427f-959c-ec9b4d89a37b could not be found. Jul 05 13:01:08.038998 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-c8f8e323-ecca-47e7-9cfb-36d74554ae5d tempest-VolumesSnapshotsTestJSON-1504263392 tempest-VolumesSnapshotsTestJSON-1504263392-project] Request method failure captured: Jul 05 13:01:08.038998 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: request: GET /compute/v2.1/os-volumes/8a78df38-c4d5-427f-959c-ec9b4d89a37b HTTP/1.1 Jul 05 13:01:08.038998 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept: application/json Jul 05 13:01:08.038998 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept-Encoding: identity Jul 05 13:01:08.038998 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Connection: close Jul 05 13:01:08.038998 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Length: 0 Jul 05 13:01:08.038998 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Type: application/json Jul 05 13:01:08.038998 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Host: 10.222.0.36 Jul 05 13:01:08.038998 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Openstack-System-Scope: None Jul 05 13:01:08.038998 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: User-Agent: python-urllib3/1.26.9 Jul 05 13:01:08.038998 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Auth-Token: gAAAAABixDYGgEQBbHuNv1E9cMJ4yDZw6DZD9KekVIB9I5IPUeg1uukkikEnhoTjozXv-kmWgHyMxxjPOB0MgogOk3jY_WGxlRAWGmjrmpu4EAO78gfBsCm9jo1ni1HVFAdR6Vs08RRbnyDZVGmxoIivKYYlWtY09BGNA45oLhozrVlcuKKockk Jul 05 13:01:08.038998 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Id: None Jul 05 13:01:08.038998 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Name: None Jul 05 13:01:08.038998 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Identity-Status: Confirmed Jul 05 13:01:08.038998 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Is-Admin-Project: True Jul 05 13:01:08.038998 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Id: default Jul 05 13:01:08.038998 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Name: Default Jul 05 13:01:08.038998 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Id: cb21718b212946f4ae9d68290e43b46e Jul 05 13:01:08.038998 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1504263392 Jul 05 13:01:08.038998 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Role: member,reader Jul 05 13:01:08.038998 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Roles: member,reader Jul 05 13:01:08.041021 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/cb21718b212946f4ae9d68290e43b46e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_cb21718b212946f4ae9d68290e43b46e", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/cb21718b212946f4ae9d68290e43b46e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/cb21718b212946f4ae9d68290e43b46e"}]}] Jul 05 13:01:08.041021 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1504263392 Jul 05 13:01:08.041021 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Id: cb21718b212946f4ae9d68290e43b46e Jul 05 13:01:08.041021 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1504263392 Jul 05 13:01:08.041021 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User: tempest-VolumesSnapshotsTestJSON-1504263392-project Jul 05 13:01:08.041021 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Id: default Jul 05 13:01:08.041021 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Name: Default Jul 05 13:01:08.041021 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Id: 1f36ee437cac4538b20aa06cabaacc59 Jul 05 13:01:08.041021 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1504263392-project Jul 05 13:01:08.041021 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: method: Jul 05 13:01:08.041021 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: exception: Volume 8a78df38-c4d5-427f-959c-ec9b4d89a37b could not be found. Jul 05 13:01:08.041021 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: action_args: {'id': '8a78df38-c4d5-427f-959c-ec9b4d89a37b'} Jul 05 13:01:08.041021 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 13:01:08.041859 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:01:08.041859 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 05 13:01:08.041859 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 05 13:01:08.041859 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 05 13:01:08.041859 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 05 13:01:08.041859 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 05 13:01:08.041859 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 05 13:01:08.041859 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 05 13:01:08.041859 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 05 13:01:08.041859 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 05 13:01:08.041859 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 05 13:01:08.041859 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 05 13:01:08.041859 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 05 13:01:08.041859 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 05 13:01:08.041859 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 05 13:01:08.041859 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8a78df38-c4d5-427f-959c-ec9b4d89a37b could not be found. (HTTP 404) (Request-ID: req-7cb21e41-61c2-463f-8bd2-66e6d44efbee) Jul 05 13:01:08.041859 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:01:08.041859 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:01:08.041859 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:01:08.043004 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:01:08.043004 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 05 13:01:08.043004 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 05 13:01:08.043004 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 05 13:01:08.043004 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 05 13:01:08.043004 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 05 13:01:08.043004 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 05 13:01:08.043004 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 05 13:01:08.043004 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 05 13:01:08.043004 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 05 13:01:08.043004 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 05 13:01:08.043004 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 05 13:01:08.043004 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 05 13:01:08.043004 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 05 13:01:08.043004 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 05 13:01:08.043004 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 05 13:01:08.043004 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 05 13:01:08.043004 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 05 13:01:08.043004 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 05 13:01:08.043906 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 05 13:01:08.043906 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 05 13:01:08.043906 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 05 13:01:08.043906 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 05 13:01:08.043906 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8a78df38-c4d5-427f-959c-ec9b4d89a37b could not be found. Jul 05 13:01:08.043906 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:01:08.043906 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:01:08.043906 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:01:08.043906 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:01:08.043906 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:01:08.043906 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:01:08.043906 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 13:01:08.043906 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 13:01:08.043906 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 05 13:01:08.043906 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 05 13:01:08.043906 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 13:01:08.043906 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 13:01:08.043906 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 05 13:01:08.043906 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 13:01:08.046253 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8a78df38-c4d5-427f-959c-ec9b4d89a37b could not be found. Jul 05 13:01:08.046253 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:01:08.046253 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:01:08.046253 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:01:08.046253 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:01:08.046253 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:01:08.046253 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:01:08.046253 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 13:01:08.046253 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 13:01:08.046253 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8a78df38-c4d5-427f-959c-ec9b4d89a37b could not be found. Jul 05 13:01:08.046253 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:01:08.046253 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-c8f8e323-ecca-47e7-9cfb-36d74554ae5d tempest-VolumesSnapshotsTestJSON-1504263392 tempest-VolumesSnapshotsTestJSON-1504263392-project] Returning 404 to user: Volume 8a78df38-c4d5-427f-959c-ec9b4d89a37b could not be found. {{(pid=118387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 13:01:08.046253 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-c8f8e323-ecca-47e7-9cfb-36d74554ae5d tempest-VolumesSnapshotsTestJSON-1504263392 tempest-VolumesSnapshotsTestJSON-1504263392-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/8a78df38-c4d5-427f-959c-ec9b4d89a37b" status: 404 len: 109 microversion: 2.1 time: 0.399821 Jul 05 13:01:08.046253 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 12/26] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Jul 5 13:01:07 2022] GET /compute/v2.1/os-volumes/8a78df38-c4d5-427f-959c-ec9b4d89a37b => generated 109 bytes in 404 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 13:01:08.059483 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-4f25d917-4709-4df3-b340-1bd53f8e256a tempest-VolumesSnapshotsTestJSON-1504263392 tempest-VolumesSnapshotsTestJSON-1504263392-project] Calling method '.version_select at 0x7f70e0473af0>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:08.123612 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.wsgi [None req-4f25d917-4709-4df3-b340-1bd53f8e256a tempest-VolumesSnapshotsTestJSON-1504263392 tempest-VolumesSnapshotsTestJSON-1504263392-project] HTTP exception thrown: Volume 8a78df38-c4d5-427f-959c-ec9b4d89a37b could not be found. Jul 05 13:01:08.123612 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-4f25d917-4709-4df3-b340-1bd53f8e256a tempest-VolumesSnapshotsTestJSON-1504263392 tempest-VolumesSnapshotsTestJSON-1504263392-project] Request method failure captured: Jul 05 13:01:08.123612 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: request: DELETE /compute/v2.1/os-volumes/8a78df38-c4d5-427f-959c-ec9b4d89a37b HTTP/1.1 Jul 05 13:01:08.123612 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Accept: application/json Jul 05 13:01:08.123612 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Accept-Encoding: identity Jul 05 13:01:08.123612 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Connection: close Jul 05 13:01:08.123612 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Content-Length: 0 Jul 05 13:01:08.123612 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Content-Type: application/json Jul 05 13:01:08.123612 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Host: 10.222.0.36 Jul 05 13:01:08.123612 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Openstack-System-Scope: None Jul 05 13:01:08.123612 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: User-Agent: python-urllib3/1.26.9 Jul 05 13:01:08.123612 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Auth-Token: gAAAAABixDYGgEQBbHuNv1E9cMJ4yDZw6DZD9KekVIB9I5IPUeg1uukkikEnhoTjozXv-kmWgHyMxxjPOB0MgogOk3jY_WGxlRAWGmjrmpu4EAO78gfBsCm9jo1ni1HVFAdR6Vs08RRbnyDZVGmxoIivKYYlWtY09BGNA45oLhozrVlcuKKockk Jul 05 13:01:08.123612 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Domain-Id: None Jul 05 13:01:08.123612 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Domain-Name: None Jul 05 13:01:08.123612 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Identity-Status: Confirmed Jul 05 13:01:08.123612 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Is-Admin-Project: True Jul 05 13:01:08.123612 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Domain-Id: default Jul 05 13:01:08.123612 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Domain-Name: Default Jul 05 13:01:08.123612 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Id: cb21718b212946f4ae9d68290e43b46e Jul 05 13:01:08.123612 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1504263392 Jul 05 13:01:08.123612 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Role: member,reader Jul 05 13:01:08.123612 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Roles: member,reader Jul 05 13:01:08.124725 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/cb21718b212946f4ae9d68290e43b46e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_cb21718b212946f4ae9d68290e43b46e", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/cb21718b212946f4ae9d68290e43b46e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/cb21718b212946f4ae9d68290e43b46e"}]}] Jul 05 13:01:08.124725 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1504263392 Jul 05 13:01:08.124725 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Tenant-Id: cb21718b212946f4ae9d68290e43b46e Jul 05 13:01:08.124725 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1504263392 Jul 05 13:01:08.124725 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User: tempest-VolumesSnapshotsTestJSON-1504263392-project Jul 05 13:01:08.124725 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Domain-Id: default Jul 05 13:01:08.124725 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Domain-Name: Default Jul 05 13:01:08.124725 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Id: 1f36ee437cac4538b20aa06cabaacc59 Jul 05 13:01:08.124725 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1504263392-project Jul 05 13:01:08.124725 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: method: Jul 05 13:01:08.124725 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: exception: Volume 8a78df38-c4d5-427f-959c-ec9b4d89a37b could not be found. Jul 05 13:01:08.124725 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: action_args: {'id': '8a78df38-c4d5-427f-959c-ec9b4d89a37b'} Jul 05 13:01:08.124725 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 13:01:08.125437 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:01:08.125437 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 05 13:01:08.125437 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 05 13:01:08.125437 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 05 13:01:08.125437 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 05 13:01:08.125437 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 05 13:01:08.125437 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 05 13:01:08.125437 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 05 13:01:08.125437 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 05 13:01:08.125437 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 05 13:01:08.125437 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 05 13:01:08.125437 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 05 13:01:08.125437 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 05 13:01:08.125437 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 05 13:01:08.125437 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 05 13:01:08.125437 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8a78df38-c4d5-427f-959c-ec9b4d89a37b could not be found. (HTTP 404) (Request-ID: req-f0947adf-82de-42da-8514-9fefd2947985) Jul 05 13:01:08.125437 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:01:08.125437 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:01:08.125437 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:01:08.126381 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:01:08.126381 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 05 13:01:08.126381 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 05 13:01:08.126381 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 05 13:01:08.126381 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 05 13:01:08.126381 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 05 13:01:08.126381 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 05 13:01:08.126381 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 05 13:01:08.126381 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 05 13:01:08.126381 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 05 13:01:08.126381 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 05 13:01:08.126381 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 05 13:01:08.126381 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 05 13:01:08.126381 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 05 13:01:08.126381 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 05 13:01:08.126381 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 05 13:01:08.126381 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 05 13:01:08.126381 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 05 13:01:08.126381 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 05 13:01:08.128482 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 05 13:01:08.128482 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 05 13:01:08.128482 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 05 13:01:08.128482 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 05 13:01:08.128482 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8a78df38-c4d5-427f-959c-ec9b4d89a37b could not be found. Jul 05 13:01:08.128482 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:01:08.128482 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:01:08.128482 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:01:08.128482 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:01:08.128482 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:01:08.128482 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:01:08.128482 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 13:01:08.128482 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 13:01:08.128482 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 05 13:01:08.128482 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 05 13:01:08.128482 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 13:01:08.128482 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 13:01:08.128482 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 05 13:01:08.128482 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 13:01:08.129429 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8a78df38-c4d5-427f-959c-ec9b4d89a37b could not be found. Jul 05 13:01:08.129429 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:01:08.129429 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:01:08.129429 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:01:08.129429 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:01:08.129429 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:01:08.129429 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:01:08.129429 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 13:01:08.129429 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 13:01:08.129429 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8a78df38-c4d5-427f-959c-ec9b4d89a37b could not be found. Jul 05 13:01:08.129429 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:01:08.129429 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-4f25d917-4709-4df3-b340-1bd53f8e256a tempest-VolumesSnapshotsTestJSON-1504263392 tempest-VolumesSnapshotsTestJSON-1504263392-project] Returning 404 to user: Volume 8a78df38-c4d5-427f-959c-ec9b4d89a37b could not be found. {{(pid=118386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 13:01:08.129429 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-4f25d917-4709-4df3-b340-1bd53f8e256a tempest-VolumesSnapshotsTestJSON-1504263392 tempest-VolumesSnapshotsTestJSON-1504263392-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/8a78df38-c4d5-427f-959c-ec9b4d89a37b" status: 404 len: 109 microversion: 2.1 time: 0.065645 Jul 05 13:01:08.129429 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 15/27] 10.222.0.36 () {58 vars in 1247 bytes} [Tue Jul 5 13:01:08 2022] DELETE /compute/v2.1/os-volumes/8a78df38-c4d5-427f-959c-ec9b4d89a37b => generated 109 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 13:01:08.130801 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-07ecfaa0-d978-405a-b6b0-d4839c05ad12 tempest-VolumesSnapshotsTestJSON-1504263392 tempest-VolumesSnapshotsTestJSON-1504263392-project] Calling method '.version_select at 0x7f70e0508940>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:08.205438 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.wsgi [None req-07ecfaa0-d978-405a-b6b0-d4839c05ad12 tempest-VolumesSnapshotsTestJSON-1504263392 tempest-VolumesSnapshotsTestJSON-1504263392-project] HTTP exception thrown: Volume 8a78df38-c4d5-427f-959c-ec9b4d89a37b could not be found. Jul 05 13:01:08.207081 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-07ecfaa0-d978-405a-b6b0-d4839c05ad12 tempest-VolumesSnapshotsTestJSON-1504263392 tempest-VolumesSnapshotsTestJSON-1504263392-project] Request method failure captured: Jul 05 13:01:08.207081 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: request: GET /compute/v2.1/os-volumes/8a78df38-c4d5-427f-959c-ec9b4d89a37b HTTP/1.1 Jul 05 13:01:08.207081 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept: application/json Jul 05 13:01:08.207081 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept-Encoding: identity Jul 05 13:01:08.207081 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Connection: close Jul 05 13:01:08.207081 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Length: 0 Jul 05 13:01:08.207081 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Type: application/json Jul 05 13:01:08.207081 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Host: 10.222.0.36 Jul 05 13:01:08.207081 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Openstack-System-Scope: None Jul 05 13:01:08.207081 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: User-Agent: python-urllib3/1.26.9 Jul 05 13:01:08.207081 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Auth-Token: gAAAAABixDYGgEQBbHuNv1E9cMJ4yDZw6DZD9KekVIB9I5IPUeg1uukkikEnhoTjozXv-kmWgHyMxxjPOB0MgogOk3jY_WGxlRAWGmjrmpu4EAO78gfBsCm9jo1ni1HVFAdR6Vs08RRbnyDZVGmxoIivKYYlWtY09BGNA45oLhozrVlcuKKockk Jul 05 13:01:08.207081 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Id: None Jul 05 13:01:08.207081 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Name: None Jul 05 13:01:08.207081 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Identity-Status: Confirmed Jul 05 13:01:08.207081 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Is-Admin-Project: True Jul 05 13:01:08.207081 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Id: default Jul 05 13:01:08.207081 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Name: Default Jul 05 13:01:08.207081 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Id: cb21718b212946f4ae9d68290e43b46e Jul 05 13:01:08.207081 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1504263392 Jul 05 13:01:08.207081 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Role: member,reader Jul 05 13:01:08.207081 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Roles: member,reader Jul 05 13:01:08.208121 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/cb21718b212946f4ae9d68290e43b46e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_cb21718b212946f4ae9d68290e43b46e", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/cb21718b212946f4ae9d68290e43b46e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/cb21718b212946f4ae9d68290e43b46e"}]}] Jul 05 13:01:08.208121 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1504263392 Jul 05 13:01:08.208121 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Id: cb21718b212946f4ae9d68290e43b46e Jul 05 13:01:08.208121 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1504263392 Jul 05 13:01:08.208121 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User: tempest-VolumesSnapshotsTestJSON-1504263392-project Jul 05 13:01:08.208121 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Id: default Jul 05 13:01:08.208121 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Name: Default Jul 05 13:01:08.208121 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Id: 1f36ee437cac4538b20aa06cabaacc59 Jul 05 13:01:08.208121 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1504263392-project Jul 05 13:01:08.208121 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: method: Jul 05 13:01:08.208121 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: exception: Volume 8a78df38-c4d5-427f-959c-ec9b4d89a37b could not be found. Jul 05 13:01:08.208121 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: action_args: {'id': '8a78df38-c4d5-427f-959c-ec9b4d89a37b'} Jul 05 13:01:08.208121 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 13:01:08.208788 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:01:08.208788 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 05 13:01:08.208788 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 05 13:01:08.208788 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 05 13:01:08.208788 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 05 13:01:08.208788 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 05 13:01:08.208788 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 05 13:01:08.208788 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 05 13:01:08.208788 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 05 13:01:08.208788 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 05 13:01:08.208788 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 05 13:01:08.208788 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 05 13:01:08.208788 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 05 13:01:08.208788 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 05 13:01:08.208788 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 05 13:01:08.208788 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8a78df38-c4d5-427f-959c-ec9b4d89a37b could not be found. (HTTP 404) (Request-ID: req-2b8e0bf3-2e33-456b-83c1-7fca57bae8b7) Jul 05 13:01:08.208788 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:01:08.208788 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:01:08.208788 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:01:08.209829 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:01:08.209829 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 05 13:01:08.209829 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 05 13:01:08.209829 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 05 13:01:08.209829 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 05 13:01:08.209829 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 05 13:01:08.209829 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 05 13:01:08.209829 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 05 13:01:08.209829 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 05 13:01:08.209829 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 05 13:01:08.209829 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 05 13:01:08.209829 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 05 13:01:08.209829 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 05 13:01:08.209829 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 05 13:01:08.209829 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 05 13:01:08.209829 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 05 13:01:08.209829 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 05 13:01:08.209829 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 05 13:01:08.209829 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 05 13:01:08.210680 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 05 13:01:08.210680 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 05 13:01:08.210680 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 05 13:01:08.210680 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 05 13:01:08.210680 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8a78df38-c4d5-427f-959c-ec9b4d89a37b could not be found. Jul 05 13:01:08.210680 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:01:08.210680 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:01:08.210680 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:01:08.210680 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:01:08.210680 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:01:08.210680 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:01:08.210680 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 13:01:08.210680 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 13:01:08.210680 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 05 13:01:08.210680 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 05 13:01:08.210680 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 13:01:08.210680 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 13:01:08.210680 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 05 13:01:08.210680 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 13:01:08.212703 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8a78df38-c4d5-427f-959c-ec9b4d89a37b could not be found. Jul 05 13:01:08.212703 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:01:08.212703 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:01:08.212703 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:01:08.212703 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:01:08.212703 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:01:08.212703 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:01:08.212703 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 13:01:08.212703 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 13:01:08.212703 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8a78df38-c4d5-427f-959c-ec9b4d89a37b could not be found. Jul 05 13:01:08.212703 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:01:08.212703 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-07ecfaa0-d978-405a-b6b0-d4839c05ad12 tempest-VolumesSnapshotsTestJSON-1504263392 tempest-VolumesSnapshotsTestJSON-1504263392-project] Returning 404 to user: Volume 8a78df38-c4d5-427f-959c-ec9b4d89a37b could not be found. {{(pid=118387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 13:01:08.212703 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-07ecfaa0-d978-405a-b6b0-d4839c05ad12 tempest-VolumesSnapshotsTestJSON-1504263392 tempest-VolumesSnapshotsTestJSON-1504263392-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/8a78df38-c4d5-427f-959c-ec9b4d89a37b" status: 404 len: 109 microversion: 2.1 time: 0.083969 Jul 05 13:01:08.212703 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 13/28] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Jul 5 13:01:08 2022] GET /compute/v2.1/os-volumes/8a78df38-c4d5-427f-959c-ec9b4d89a37b => generated 109 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 13:01:09.253751 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-9ff4050b-9c42-4b15-b85e-80574f335f79 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Action: 'create', calling method: .version_select at 0x7f70e0473790>, body: {"keypair": {"name": "tempest-keypair-1458947569", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNAvwjG+Hh15s2sZ8uCO1jgKOBL+FC+9b6jUcsIS0oAx1My0/SxEa+RWao5ClyyxZB/wWoaojs7lY/BuddKAPzZaICUnELZHeUvw4TWSvHEVQPWzjLPJYYwPeOGkjqKOqA=="}} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:01:09.422698 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.quota [None req-9ff4050b-9c42-4b15-b85e-80574f335f79 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Getting quotas for project 6c201d76ac4e4cc08fdc38e7165d4764. Resources: {'key_pairs'} {{(pid=118386) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 13:01:09.462849 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.quota [None req-9ff4050b-9c42-4b15-b85e-80574f335f79 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Getting quotas for user 475bac060a98475d858e6181eec7ce11 and project 6c201d76ac4e4cc08fdc38e7165d4764. Resources: {'key_pairs'} {{(pid=118386) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 13:01:09.686939 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-9ff4050b-9c42-4b15-b85e-80574f335f79 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.229609 Jul 05 13:01:09.691781 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 16/29] 10.222.0.36 () {62 vars in 1199 bytes} [Tue Jul 5 13:01:08 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1232 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 05 13:01:11.428813 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-4908d0d4-790e-495f-8bb7-800e97288616 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Action: 'create', calling method: .version_select at 0x7f70e0ed28b0>, body: {"keypair": {"name": "tempest-keypair-1376741962", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBErpiMm0eZNd8SkewlR2aeKZ8+Q5gtwjjBo7LPUxmjTQd6MZkqIi/7xhirrQpLL16KaxQXBqmKg5tUDgA5iykRQoiwA9BJeCf6ZU3D6UsVRIm4KLIuVwiVdpkORraWkMPg=="}} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:01:11.549755 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.quota [None req-4908d0d4-790e-495f-8bb7-800e97288616 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Getting quotas for project 163f0d5f47be49f493296f228d1080a5. Resources: {'key_pairs'} {{(pid=118387) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 13:01:11.558059 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.quota [None req-4908d0d4-790e-495f-8bb7-800e97288616 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Getting quotas for user aa97e27060b3429bbad061a256db19f1 and project 163f0d5f47be49f493296f228d1080a5. Resources: {'key_pairs'} {{(pid=118387) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 13:01:11.850118 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-4908d0d4-790e-495f-8bb7-800e97288616 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.291233 Jul 05 13:01:11.850898 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 14/30] 10.222.0.36 () {60 vars in 1158 bytes} [Tue Jul 5 13:01:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:01:12.073646 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-1b11bb07-607b-48ca-b77c-edaf5a0940e0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-289648511", "imageRef": "d6134305-a5c0-4d2c-afc8-e54be21f685c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:01:12.294230 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.network.neutron [None req-1b11bb07-607b-48ca-b77c-edaf5a0940e0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] validate_networks() for [('f39eed6c-2ca3-432a-8440-fb8b99c5c5bb', None, None, None, None, None)] {{(pid=118386) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 13:01:14.263525 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-113ae3a1-9f16-4200-930a-7bf4f1c76799 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2094739005", "imageRef": "d6134305-a5c0-4d2c-afc8-e54be21f685c", "flavorRef": "452", "networks": [{"uuid": "956a505d-3597-48b2-96e0-d4f95a9a2b92"}]}} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:01:14.507593 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.network.neutron [None req-113ae3a1-9f16-4200-930a-7bf4f1c76799 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] validate_networks() for [('956a505d-3597-48b2-96e0-d4f95a9a2b92', None, None, None, None, None)] {{(pid=118387) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 13:01:15.101252 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.virt.hardware [None req-1b11bb07-607b-48ca-b77c-edaf5a0940e0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Flavor limits 0:0:0 {{(pid=118386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 13:01:15.101787 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.virt.hardware [None req-1b11bb07-607b-48ca-b77c-edaf5a0940e0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Image limits 0:0:0 {{(pid=118386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 13:01:15.102300 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.virt.hardware [None req-1b11bb07-607b-48ca-b77c-edaf5a0940e0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Flavor pref 0:0:0 {{(pid=118386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 13:01:15.103140 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.virt.hardware [None req-1b11bb07-607b-48ca-b77c-edaf5a0940e0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Image pref 0:0:0 {{(pid=118386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 13:01:15.103582 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.virt.hardware [None req-1b11bb07-607b-48ca-b77c-edaf5a0940e0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 13:01:15.134418 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-1b11bb07-607b-48ca-b77c-edaf5a0940e0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:15.135153 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-1b11bb07-607b-48ca-b77c-edaf5a0940e0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:15.137431 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-1b11bb07-607b-48ca-b77c-edaf5a0940e0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:15.139415 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-1b11bb07-607b-48ca-b77c-edaf5a0940e0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:15.246784 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.quota [None req-1b11bb07-607b-48ca-b77c-edaf5a0940e0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Getting quotas for project 7836a0ee154744b49a323e6b94860e50. Resources: {'instances', 'cores', 'ram'} {{(pid=118386) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 13:01:15.266369 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.quota [None req-1b11bb07-607b-48ca-b77c-edaf5a0940e0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Getting quotas for user ad3f91c024f8415cac4784fec0689757 and project 7836a0ee154744b49a323e6b94860e50. Resources: {'instances', 'cores', 'ram'} {{(pid=118386) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 13:01:15.288549 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-1b11bb07-607b-48ca-b77c-edaf5a0940e0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Going to run 1 instances... {{(pid=118386) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 13:01:15.294190 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-1b11bb07-607b-48ca-b77c-edaf5a0940e0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 2d17971e-35b1-437a-baca-1306740b41c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d6134305-a5c0-4d2c-afc8-e54be21f685c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118386) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 13:01:15.536912 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-1b11bb07-607b-48ca-b77c-edaf5a0940e0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.205606 Jul 05 13:01:15.537907 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 17/31] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jul 5 13:01:11 2022] POST /compute/v2.1/servers => generated 383 bytes in 4207 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 05 13:01:15.547576 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-a1622b14-a92f-4ca0-be18-77ecab97dbde tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1583041916", "imageRef": "d6134305-a5c0-4d2c-afc8-e54be21f685c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e3e95bfb-f6c2-445d-9afc-40a708c30441"}], "security_groups": [{"name": "tempest-securitygroup--167832674"}], "key_name": "tempest-keypair-1458947569", "user_data": "}} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:01:15.863815 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.network.neutron [None req-a1622b14-a92f-4ca0-be18-77ecab97dbde tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] validate_networks() for [('e3e95bfb-f6c2-445d-9afc-40a708c30441', None, None, None, None, None)] {{(pid=118386) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 13:01:17.581429 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-113ae3a1-9f16-4200-930a-7bf4f1c76799 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Flavor limits 0:0:0 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 13:01:17.585611 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-113ae3a1-9f16-4200-930a-7bf4f1c76799 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Image limits 0:0:0 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 13:01:17.585611 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-113ae3a1-9f16-4200-930a-7bf4f1c76799 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Flavor pref 0:0:0 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 13:01:17.585611 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-113ae3a1-9f16-4200-930a-7bf4f1c76799 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Image pref 0:0:0 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 13:01:17.585611 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-113ae3a1-9f16-4200-930a-7bf4f1c76799 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 13:01:17.602589 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-113ae3a1-9f16-4200-930a-7bf4f1c76799 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:17.620724 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-113ae3a1-9f16-4200-930a-7bf4f1c76799 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:17.623202 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-113ae3a1-9f16-4200-930a-7bf4f1c76799 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:17.623669 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-113ae3a1-9f16-4200-930a-7bf4f1c76799 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:17.694208 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.quota [None req-113ae3a1-9f16-4200-930a-7bf4f1c76799 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Getting quotas for project 79d337ebe3a0475b9331780325e17451. Resources: {'instances', 'cores', 'ram'} {{(pid=118387) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 13:01:17.700971 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.quota [None req-113ae3a1-9f16-4200-930a-7bf4f1c76799 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Getting quotas for user ac264b6684ae4c3f9fc8903163693d6f and project 79d337ebe3a0475b9331780325e17451. Resources: {'instances', 'cores', 'ram'} {{(pid=118387) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 13:01:17.729195 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-113ae3a1-9f16-4200-930a-7bf4f1c76799 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Going to run 1 instances... {{(pid=118387) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 13:01:17.737502 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-113ae3a1-9f16-4200-930a-7bf4f1c76799 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] [instance: 60d29496-d306-4d93-b1ca-23afb86dd55a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d6134305-a5c0-4d2c-afc8-e54be21f685c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118387) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 13:01:17.861470 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.virt.hardware [None req-a1622b14-a92f-4ca0-be18-77ecab97dbde tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Flavor limits 0:0:0 {{(pid=118386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 13:01:17.861470 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.virt.hardware [None req-a1622b14-a92f-4ca0-be18-77ecab97dbde tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Image limits 0:0:0 {{(pid=118386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 13:01:17.861470 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.virt.hardware [None req-a1622b14-a92f-4ca0-be18-77ecab97dbde tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Flavor pref 0:0:0 {{(pid=118386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 13:01:17.861470 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.virt.hardware [None req-a1622b14-a92f-4ca0-be18-77ecab97dbde tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Image pref 0:0:0 {{(pid=118386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 13:01:17.861470 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.virt.hardware [None req-a1622b14-a92f-4ca0-be18-77ecab97dbde tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 13:01:17.885450 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a1622b14-a92f-4ca0-be18-77ecab97dbde tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:17.885902 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a1622b14-a92f-4ca0-be18-77ecab97dbde tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:17.886721 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a1622b14-a92f-4ca0-be18-77ecab97dbde tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:17.887159 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a1622b14-a92f-4ca0-be18-77ecab97dbde tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:17.923935 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.quota [None req-a1622b14-a92f-4ca0-be18-77ecab97dbde tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Getting quotas for project 6c201d76ac4e4cc08fdc38e7165d4764. Resources: {'instances', 'cores', 'ram'} {{(pid=118386) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 13:01:17.932661 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.quota [None req-a1622b14-a92f-4ca0-be18-77ecab97dbde tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Getting quotas for user 475bac060a98475d858e6181eec7ce11 and project 6c201d76ac4e4cc08fdc38e7165d4764. Resources: {'instances', 'cores', 'ram'} {{(pid=118386) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 13:01:17.949819 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-a1622b14-a92f-4ca0-be18-77ecab97dbde tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Going to run 1 instances... {{(pid=118386) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 13:01:17.952204 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-a1622b14-a92f-4ca0-be18-77ecab97dbde tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d6134305-a5c0-4d2c-afc8-e54be21f685c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118386) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 13:01:17.998212 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-113ae3a1-9f16-4200-930a-7bf4f1c76799 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.548269 Jul 05 13:01:17.999441 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 15/32] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jul 5 13:01:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 4550 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 05 13:01:18.008967 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-6e7f107c-c75a-4a41-a347-c837d90bf8c6 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:18.012953 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-6e7f107c-c75a-4a41-a347-c837d90bf8c6 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 2d17971e-35b1-437a-baca-1306740b41c0] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:18.210309 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-a1622b14-a92f-4ca0-be18-77ecab97dbde tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.670722 Jul 05 13:01:18.214452 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 18/33] 10.222.0.36 () {62 vars in 1187 bytes} [Tue Jul 5 13:01:15 2022] POST /compute/v2.1/servers => generated 401 bytes in 2674 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 05 13:01:18.221896 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-1872e9ba-20e5-4386-ad50-a526ac3e7643 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:18.228005 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-1872e9ba-20e5-4386-ad50-a526ac3e7643 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] [instance: 60d29496-d306-4d93-b1ca-23afb86dd55a] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:18.377671 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-6e7f107c-c75a-4a41-a347-c837d90bf8c6 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:18.442055 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-6e7f107c-c75a-4a41-a347-c837d90bf8c6 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0" status: 200 len: 1221 microversion: 2.1 time: 0.434570 Jul 05 13:01:18.454770 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 16/34] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:17 2022] GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0 => generated 1221 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:01:18.517070 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-24348e75-252f-4e50-bc85-a5032cccf460 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:18.517730 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-24348e75-252f-4e50-bc85-a5032cccf460 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:18.598191 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-1872e9ba-20e5-4386-ad50-a526ac3e7643 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac264b6684ae4c3f9fc8903163693d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d337ebe3a0475b9331780325e17451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:18.628791 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-1872e9ba-20e5-4386-ad50-a526ac3e7643 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] 10.222.0.36 "GET /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a" status: 200 len: 1215 microversion: 2.1 time: 0.412919 Jul 05 13:01:18.631448 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 19/35] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:18 2022] GET /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a => generated 1215 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:01:18.734642 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-8cbf4cff-bebc-459b-b77b-6aab34f06a1f tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1686077682", "imageRef": "d6134305-a5c0-4d2c-afc8-e54be21f685c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3aaa0da9-0f6f-4fc6-8a51-4d7d6726eda8"}], "security_groups": [{"name": "tempest-securitygroup--426219691"}], "key_name": "tempest-keypair-1376741962", "user_data": "}} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:01:18.816555 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-24348e75-252f-4e50-bc85-a5032cccf460 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:18.825300 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-24348e75-252f-4e50-bc85-a5032cccf460 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:18.847365 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-24348e75-252f-4e50-bc85-a5032cccf460 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:18.853693 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-24348e75-252f-4e50-bc85-a5032cccf460 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1282 microversion: 2.20 time: 0.397350 Jul 05 13:01:18.854311 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 17/36] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:01:18 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1282 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:01:18.920707 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-d5f44c4b-808f-45b1-b526-c765e0a8d003 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1063728683", "imageRef": "d6134305-a5c0-4d2c-afc8-e54be21f685c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:01:19.035788 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.network.neutron [None req-8cbf4cff-bebc-459b-b77b-6aab34f06a1f tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] validate_networks() for [('3aaa0da9-0f6f-4fc6-8a51-4d7d6726eda8', None, None, None, None, None)] {{(pid=118386) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 13:01:19.095507 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.network.neutron [None req-d5f44c4b-808f-45b1-b526-c765e0a8d003 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] validate_networks() for [('f39eed6c-2ca3-432a-8440-fb8b99c5c5bb', None, None, None, None, None)] {{(pid=118387) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 13:01:20.237398 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-d5f44c4b-808f-45b1-b526-c765e0a8d003 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Flavor limits 0:0:0 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 13:01:20.238022 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-d5f44c4b-808f-45b1-b526-c765e0a8d003 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Image limits 0:0:0 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 13:01:20.238299 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-d5f44c4b-808f-45b1-b526-c765e0a8d003 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Flavor pref 0:0:0 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 13:01:20.238797 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-d5f44c4b-808f-45b1-b526-c765e0a8d003 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Image pref 0:0:0 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 13:01:20.239192 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-d5f44c4b-808f-45b1-b526-c765e0a8d003 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 13:01:20.243493 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.virt.hardware [None req-8cbf4cff-bebc-459b-b77b-6aab34f06a1f tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Flavor limits 0:0:0 {{(pid=118386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 13:01:20.245291 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.virt.hardware [None req-8cbf4cff-bebc-459b-b77b-6aab34f06a1f tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Image limits 0:0:0 {{(pid=118386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 13:01:20.251458 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.virt.hardware [None req-8cbf4cff-bebc-459b-b77b-6aab34f06a1f tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Flavor pref 0:0:0 {{(pid=118386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 13:01:20.251458 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.virt.hardware [None req-8cbf4cff-bebc-459b-b77b-6aab34f06a1f tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Image pref 0:0:0 {{(pid=118386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 13:01:20.251458 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.virt.hardware [None req-8cbf4cff-bebc-459b-b77b-6aab34f06a1f tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 13:01:20.265944 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d5f44c4b-808f-45b1-b526-c765e0a8d003 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:20.266334 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d5f44c4b-808f-45b1-b526-c765e0a8d003 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:20.267133 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d5f44c4b-808f-45b1-b526-c765e0a8d003 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:20.267574 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d5f44c4b-808f-45b1-b526-c765e0a8d003 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:20.267985 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-8cbf4cff-bebc-459b-b77b-6aab34f06a1f tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:20.268711 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-8cbf4cff-bebc-459b-b77b-6aab34f06a1f tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:20.269669 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-8cbf4cff-bebc-459b-b77b-6aab34f06a1f tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:20.270258 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-8cbf4cff-bebc-459b-b77b-6aab34f06a1f tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:20.288911 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.quota [None req-8cbf4cff-bebc-459b-b77b-6aab34f06a1f tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Getting quotas for project 163f0d5f47be49f493296f228d1080a5. Resources: {'instances', 'cores', 'ram'} {{(pid=118386) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 13:01:20.293146 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.quota [None req-d5f44c4b-808f-45b1-b526-c765e0a8d003 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Getting quotas for project 7836a0ee154744b49a323e6b94860e50. Resources: {'instances', 'cores', 'ram'} {{(pid=118387) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 13:01:20.293635 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.quota [None req-8cbf4cff-bebc-459b-b77b-6aab34f06a1f tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Getting quotas for user aa97e27060b3429bbad061a256db19f1 and project 163f0d5f47be49f493296f228d1080a5. Resources: {'instances', 'cores', 'ram'} {{(pid=118386) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 13:01:20.298668 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.quota [None req-d5f44c4b-808f-45b1-b526-c765e0a8d003 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Getting quotas for user ad3f91c024f8415cac4784fec0689757 and project 7836a0ee154744b49a323e6b94860e50. Resources: {'instances', 'cores', 'ram'} {{(pid=118387) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 13:01:20.307525 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-8cbf4cff-bebc-459b-b77b-6aab34f06a1f tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Going to run 1 instances... {{(pid=118386) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 13:01:20.310163 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-8cbf4cff-bebc-459b-b77b-6aab34f06a1f tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 0f8f2957-1273-413b-ab2b-32da8868f70d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d6134305-a5c0-4d2c-afc8-e54be21f685c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118386) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 13:01:20.316854 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-d5f44c4b-808f-45b1-b526-c765e0a8d003 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Going to run 1 instances... {{(pid=118387) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 13:01:20.319172 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-d5f44c4b-808f-45b1-b526-c765e0a8d003 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d6134305-a5c0-4d2c-afc8-e54be21f685c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118387) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 13:01:20.523382 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-8cbf4cff-bebc-459b-b77b-6aab34f06a1f tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.805156 Jul 05 13:01:20.524081 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 20/37] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jul 5 13:01:18 2022] POST /compute/v2.1/servers => generated 401 bytes in 1807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 05 13:01:20.532974 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-8c1cc3c1-2a10-405f-821e-59737b8e8bfa tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:20.536204 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-8c1cc3c1-2a10-405f-821e-59737b8e8bfa tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] [instance: 60d29496-d306-4d93-b1ca-23afb86dd55a] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:20.556613 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-d5f44c4b-808f-45b1-b526-c765e0a8d003 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.641150 Jul 05 13:01:20.567263 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 18/38] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jul 5 13:01:18 2022] POST /compute/v2.1/servers => generated 383 bytes in 1653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 05 13:01:20.579974 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-d06a8032-31aa-4727-989f-ec8baa1bed28 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:20.604997 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-d06a8032-31aa-4727-989f-ec8baa1bed28 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:20.627726 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d06a8032-31aa-4727-989f-ec8baa1bed28 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:20.627726 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d06a8032-31aa-4727-989f-ec8baa1bed28 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:20.627726 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d06a8032-31aa-4727-989f-ec8baa1bed28 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:20.627726 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d06a8032-31aa-4727-989f-ec8baa1bed28 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:20.662272 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-8c1cc3c1-2a10-405f-821e-59737b8e8bfa tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac264b6684ae4c3f9fc8903163693d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d337ebe3a0475b9331780325e17451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:20.673215 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-8c1cc3c1-2a10-405f-821e-59737b8e8bfa tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] 10.222.0.36 "GET /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a" status: 200 len: 1215 microversion: 2.1 time: 0.147890 Jul 05 13:01:20.695196 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 21/39] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:20 2022] GET /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a => generated 1215 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:01:20.702749 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-0894c4b2-0cbd-4665-8f20-2c10f9ffcd0e tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:20.715853 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-0894c4b2-0cbd-4665-8f20-2c10f9ffcd0e tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 0f8f2957-1273-413b-ab2b-32da8868f70d] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:20.887470 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-0894c4b2-0cbd-4665-8f20-2c10f9ffcd0e tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:20.898166 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-0894c4b2-0cbd-4665-8f20-2c10f9ffcd0e tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d" status: 200 len: 1242 microversion: 2.1 time: 0.201657 Jul 05 13:01:20.904627 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 22/40] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:20 2022] GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d => generated 1242 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:01:20.911423 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-13720a7a-9ba6-462c-a7ab-56e678d691e3 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:20.912198 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-13720a7a-9ba6-462c-a7ab-56e678d691e3 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:20.950447 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-d06a8032-31aa-4727-989f-ec8baa1bed28 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:20.969135 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-d06a8032-31aa-4727-989f-ec8baa1bed28 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:20.974055 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-d06a8032-31aa-4727-989f-ec8baa1bed28 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:20.979277 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-d06a8032-31aa-4727-989f-ec8baa1bed28 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1286 microversion: 2.20 time: 0.408051 Jul 05 13:01:20.985690 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 19/41] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:01:20 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1286 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:01:21.081455 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-13720a7a-9ba6-462c-a7ab-56e678d691e3 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:21.089205 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-13720a7a-9ba6-462c-a7ab-56e678d691e3 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1222 microversion: 2.1 time: 0.188846 Jul 05 13:01:21.090689 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 23/42] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:20 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1222 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:01:21.694289 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-2508e2f6-56b4-4494-8acc-83512f882a90 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:21.694903 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-2508e2f6-56b4-4494-8acc-83512f882a90 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] [instance: 60d29496-d306-4d93-b1ca-23afb86dd55a] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:21.713123 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2508e2f6-56b4-4494-8acc-83512f882a90 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:21.713695 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2508e2f6-56b4-4494-8acc-83512f882a90 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:21.715003 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2508e2f6-56b4-4494-8acc-83512f882a90 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:21.715458 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2508e2f6-56b4-4494-8acc-83512f882a90 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:21.805321 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-2508e2f6-56b4-4494-8acc-83512f882a90 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac264b6684ae4c3f9fc8903163693d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d337ebe3a0475b9331780325e17451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:21.821038 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-2508e2f6-56b4-4494-8acc-83512f882a90 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] 10.222.0.36 "GET /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a" status: 200 len: 1211 microversion: 2.1 time: 0.131043 Jul 05 13:01:21.821609 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 20/43] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:21 2022] GET /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a => generated 1211 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:01:21.921636 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-c7a6b19e-68aa-4f9b-afc8-cf69b7630e75 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:21.922301 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-c7a6b19e-68aa-4f9b-afc8-cf69b7630e75 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 0f8f2957-1273-413b-ab2b-32da8868f70d] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:21.976346 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-c7a6b19e-68aa-4f9b-afc8-cf69b7630e75 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:21.984346 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-c7a6b19e-68aa-4f9b-afc8-cf69b7630e75 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d" status: 200 len: 1242 microversion: 2.1 time: 0.072682 Jul 05 13:01:21.984980 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 24/44] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:21 2022] GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d => generated 1242 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:01:22.002382 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-c5649b07-e47c-4280-93e8-e3a1d694b7e4 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:22.003522 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-c5649b07-e47c-4280-93e8-e3a1d694b7e4 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:22.011077 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c5649b07-e47c-4280-93e8-e3a1d694b7e4 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:22.011737 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c5649b07-e47c-4280-93e8-e3a1d694b7e4 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:22.012748 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c5649b07-e47c-4280-93e8-e3a1d694b7e4 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:22.013492 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c5649b07-e47c-4280-93e8-e3a1d694b7e4 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:22.091183 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-c5649b07-e47c-4280-93e8-e3a1d694b7e4 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:22.099702 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-c5649b07-e47c-4280-93e8-e3a1d694b7e4 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:22.101349 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-c5649b07-e47c-4280-93e8-e3a1d694b7e4 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:22.103088 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-c5649b07-e47c-4280-93e8-e3a1d694b7e4 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1334 microversion: 2.20 time: 0.104661 Jul 05 13:01:22.104112 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 21/45] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:01:21 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1334 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:01:22.107800 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-5a2bfdb7-8ca6-4cfc-b3f4-6d393e70b7f6 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:22.111685 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-5a2bfdb7-8ca6-4cfc-b3f4-6d393e70b7f6 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:22.118883 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-5a2bfdb7-8ca6-4cfc-b3f4-6d393e70b7f6 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:22.119331 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-5a2bfdb7-8ca6-4cfc-b3f4-6d393e70b7f6 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:22.120375 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-5a2bfdb7-8ca6-4cfc-b3f4-6d393e70b7f6 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:22.120985 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-5a2bfdb7-8ca6-4cfc-b3f4-6d393e70b7f6 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:22.267667 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-5a2bfdb7-8ca6-4cfc-b3f4-6d393e70b7f6 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:22.280876 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-5a2bfdb7-8ca6-4cfc-b3f4-6d393e70b7f6 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1226 microversion: 2.1 time: 0.175396 Jul 05 13:01:22.280876 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 25/46] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:22 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1226 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:01:22.838477 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-4c623f96-8dc1-453f-88d8-bf6e27ab3d4e tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:22.839816 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-4c623f96-8dc1-453f-88d8-bf6e27ab3d4e tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] [instance: 60d29496-d306-4d93-b1ca-23afb86dd55a] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:22.846783 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4c623f96-8dc1-453f-88d8-bf6e27ab3d4e tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:22.847439 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4c623f96-8dc1-453f-88d8-bf6e27ab3d4e tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:22.848208 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4c623f96-8dc1-453f-88d8-bf6e27ab3d4e tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:22.849270 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4c623f96-8dc1-453f-88d8-bf6e27ab3d4e tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:22.947688 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-4c623f96-8dc1-453f-88d8-bf6e27ab3d4e tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac264b6684ae4c3f9fc8903163693d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d337ebe3a0475b9331780325e17451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:22.956618 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-4c623f96-8dc1-453f-88d8-bf6e27ab3d4e tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] 10.222.0.36 "GET /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a" status: 200 len: 1211 microversion: 2.1 time: 0.121723 Jul 05 13:01:22.957709 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 22/47] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:22 2022] GET /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a => generated 1211 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:01:23.001490 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-ab8f4fd3-9f01-4071-a85a-10fe7ee8ae87 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:23.002101 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-ab8f4fd3-9f01-4071-a85a-10fe7ee8ae87 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 0f8f2957-1273-413b-ab2b-32da8868f70d] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:23.008069 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ab8f4fd3-9f01-4071-a85a-10fe7ee8ae87 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:23.008536 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ab8f4fd3-9f01-4071-a85a-10fe7ee8ae87 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:23.009547 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ab8f4fd3-9f01-4071-a85a-10fe7ee8ae87 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:23.010034 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ab8f4fd3-9f01-4071-a85a-10fe7ee8ae87 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:23.070571 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-ab8f4fd3-9f01-4071-a85a-10fe7ee8ae87 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:23.077900 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-ab8f4fd3-9f01-4071-a85a-10fe7ee8ae87 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d" status: 200 len: 1246 microversion: 2.1 time: 0.080248 Jul 05 13:01:23.078445 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 26/48] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:22 2022] GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d => generated 1246 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:01:23.121305 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-6e4e9470-184c-425b-a230-802192fe49ca tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:23.121972 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-6e4e9470-184c-425b-a230-802192fe49ca tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:23.128428 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6e4e9470-184c-425b-a230-802192fe49ca tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:23.128918 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6e4e9470-184c-425b-a230-802192fe49ca tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:23.129673 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6e4e9470-184c-425b-a230-802192fe49ca tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:23.130106 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6e4e9470-184c-425b-a230-802192fe49ca tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:23.196267 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-6e4e9470-184c-425b-a230-802192fe49ca tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:23.205607 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-6e4e9470-184c-425b-a230-802192fe49ca tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:23.207143 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-6e4e9470-184c-425b-a230-802192fe49ca tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:23.208669 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-6e4e9470-184c-425b-a230-802192fe49ca tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1334 microversion: 2.20 time: 0.091187 Jul 05 13:01:23.209400 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 23/49] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:01:23 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1334 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:01:23.297035 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-2c31806e-a44b-4c74-9421-86f7b39b0338 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:23.297645 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-2c31806e-a44b-4c74-9421-86f7b39b0338 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:23.303522 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-2c31806e-a44b-4c74-9421-86f7b39b0338 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:23.303972 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-2c31806e-a44b-4c74-9421-86f7b39b0338 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:23.304761 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-2c31806e-a44b-4c74-9421-86f7b39b0338 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:23.305221 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-2c31806e-a44b-4c74-9421-86f7b39b0338 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:23.366732 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-2c31806e-a44b-4c74-9421-86f7b39b0338 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:23.374169 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-2c31806e-a44b-4c74-9421-86f7b39b0338 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1226 microversion: 2.1 time: 0.081237 Jul 05 13:01:23.374668 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 27/50] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:23 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:01:23.973358 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-3f0529a4-3313-425b-8f48-4bed046f84d6 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:23.981214 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-3f0529a4-3313-425b-8f48-4bed046f84d6 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] [instance: 60d29496-d306-4d93-b1ca-23afb86dd55a] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:23.981705 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3f0529a4-3313-425b-8f48-4bed046f84d6 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:23.982301 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3f0529a4-3313-425b-8f48-4bed046f84d6 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:23.983018 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3f0529a4-3313-425b-8f48-4bed046f84d6 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:23.983464 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3f0529a4-3313-425b-8f48-4bed046f84d6 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:24.060121 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-3f0529a4-3313-425b-8f48-4bed046f84d6 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac264b6684ae4c3f9fc8903163693d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d337ebe3a0475b9331780325e17451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:24.176280 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-3f0529a4-3313-425b-8f48-4bed046f84d6 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] 10.222.0.36 "GET /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a" status: 200 len: 1211 microversion: 2.1 time: 0.102576 Jul 05 13:01:24.176280 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 24/51] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:23 2022] GET /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a => generated 1211 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:01:24.177683 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-ef2c6dcc-22a6-4d30-b5c9-62a49970b754 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:24.177683 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-ef2c6dcc-22a6-4d30-b5c9-62a49970b754 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 0f8f2957-1273-413b-ab2b-32da8868f70d] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:24.177683 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ef2c6dcc-22a6-4d30-b5c9-62a49970b754 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:24.177683 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ef2c6dcc-22a6-4d30-b5c9-62a49970b754 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:24.179147 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ef2c6dcc-22a6-4d30-b5c9-62a49970b754 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:24.179147 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ef2c6dcc-22a6-4d30-b5c9-62a49970b754 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:24.179147 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-ef2c6dcc-22a6-4d30-b5c9-62a49970b754 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:24.187243 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-ef2c6dcc-22a6-4d30-b5c9-62a49970b754 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d" status: 200 len: 1246 microversion: 2.1 time: 0.093498 Jul 05 13:01:24.187243 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 28/52] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:24 2022] GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d => generated 1246 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:01:24.228546 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-6f09451e-c552-421e-8b7f-586413c15e48 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:24.229249 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-6f09451e-c552-421e-8b7f-586413c15e48 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:24.235502 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6f09451e-c552-421e-8b7f-586413c15e48 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:24.235963 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6f09451e-c552-421e-8b7f-586413c15e48 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:24.236772 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6f09451e-c552-421e-8b7f-586413c15e48 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:24.237221 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6f09451e-c552-421e-8b7f-586413c15e48 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:24.319211 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-6f09451e-c552-421e-8b7f-586413c15e48 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:24.329513 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-6f09451e-c552-421e-8b7f-586413c15e48 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:24.331178 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-6f09451e-c552-421e-8b7f-586413c15e48 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:24.332641 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-6f09451e-c552-421e-8b7f-586413c15e48 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1334 microversion: 2.20 time: 0.108604 Jul 05 13:01:24.333205 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 25/53] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:01:24 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1334 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:01:24.392399 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-fa4f6754-e3f0-4d82-808d-8a556e84f00c tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:24.398372 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-fa4f6754-e3f0-4d82-808d-8a556e84f00c tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:24.402744 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-fa4f6754-e3f0-4d82-808d-8a556e84f00c tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:24.403199 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-fa4f6754-e3f0-4d82-808d-8a556e84f00c tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:24.403984 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-fa4f6754-e3f0-4d82-808d-8a556e84f00c tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:24.409175 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-fa4f6754-e3f0-4d82-808d-8a556e84f00c tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:24.478731 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-fa4f6754-e3f0-4d82-808d-8a556e84f00c tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:24.486475 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-fa4f6754-e3f0-4d82-808d-8a556e84f00c tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1226 microversion: 2.1 time: 0.098708 Jul 05 13:01:24.487049 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 29/54] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:24 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:01:25.090164 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-67a9cb8b-3a7e-4979-90a4-d7b9ba24434e tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:25.092399 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-67a9cb8b-3a7e-4979-90a4-d7b9ba24434e tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] [instance: 60d29496-d306-4d93-b1ca-23afb86dd55a] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:25.098891 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-67a9cb8b-3a7e-4979-90a4-d7b9ba24434e tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:25.099677 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-67a9cb8b-3a7e-4979-90a4-d7b9ba24434e tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:25.100699 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-67a9cb8b-3a7e-4979-90a4-d7b9ba24434e tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:25.101303 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-67a9cb8b-3a7e-4979-90a4-d7b9ba24434e tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:25.202540 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-e8790e87-5a86-45ac-bdeb-366c4c920d74 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:25.203275 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-e8790e87-5a86-45ac-bdeb-366c4c920d74 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 0f8f2957-1273-413b-ab2b-32da8868f70d] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:25.210202 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e8790e87-5a86-45ac-bdeb-366c4c920d74 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:25.212913 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e8790e87-5a86-45ac-bdeb-366c4c920d74 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:25.217367 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e8790e87-5a86-45ac-bdeb-366c4c920d74 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:25.220501 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e8790e87-5a86-45ac-bdeb-366c4c920d74 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:25.236258 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-67a9cb8b-3a7e-4979-90a4-d7b9ba24434e tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac264b6684ae4c3f9fc8903163693d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d337ebe3a0475b9331780325e17451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:25.255659 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-67a9cb8b-3a7e-4979-90a4-d7b9ba24434e tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] 10.222.0.36 "GET /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a" status: 200 len: 1267 microversion: 2.1 time: 0.168867 Jul 05 13:01:25.256893 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 26/55] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:25 2022] GET /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:01:25.351520 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-b0e81e33-25a4-424c-84b0-f6d1a2ac12d2 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:25.353014 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-b0e81e33-25a4-424c-84b0-f6d1a2ac12d2 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:25.374346 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b0e81e33-25a4-424c-84b0-f6d1a2ac12d2 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:25.375482 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b0e81e33-25a4-424c-84b0-f6d1a2ac12d2 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:25.376453 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b0e81e33-25a4-424c-84b0-f6d1a2ac12d2 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:25.385467 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b0e81e33-25a4-424c-84b0-f6d1a2ac12d2 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:25.485621 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-e8790e87-5a86-45ac-bdeb-366c4c920d74 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:25.485621 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-e8790e87-5a86-45ac-bdeb-366c4c920d74 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d" status: 200 len: 1238 microversion: 2.1 time: 0.271916 Jul 05 13:01:25.485621 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 30/56] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:25 2022] GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d => generated 1238 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:01:25.511612 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-48be01fc-6ec4-4994-bcff-bfe761812cb0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:25.524850 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-48be01fc-6ec4-4994-bcff-bfe761812cb0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:25.556954 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-48be01fc-6ec4-4994-bcff-bfe761812cb0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:25.557534 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-48be01fc-6ec4-4994-bcff-bfe761812cb0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:25.560870 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-48be01fc-6ec4-4994-bcff-bfe761812cb0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:25.561531 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-48be01fc-6ec4-4994-bcff-bfe761812cb0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:25.828966 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-b0e81e33-25a4-424c-84b0-f6d1a2ac12d2 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:25.845582 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-48be01fc-6ec4-4994-bcff-bfe761812cb0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:25.856509 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-48be01fc-6ec4-4994-bcff-bfe761812cb0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1218 microversion: 2.1 time: 0.355641 Jul 05 13:01:25.857136 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 31/57] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:25 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1218 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:01:25.857247 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-b0e81e33-25a4-424c-84b0-f6d1a2ac12d2 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:25.858938 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-b0e81e33-25a4-424c-84b0-f6d1a2ac12d2 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:25.860679 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-b0e81e33-25a4-424c-84b0-f6d1a2ac12d2 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1352 microversion: 2.20 time: 0.513124 Jul 05 13:01:25.861896 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 27/58] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:01:25 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1352 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:01:26.275390 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-acb292cf-78ee-4998-9550-74bdef9aed5b tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:26.276648 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-acb292cf-78ee-4998-9550-74bdef9aed5b tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] [instance: 60d29496-d306-4d93-b1ca-23afb86dd55a] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:26.285405 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:26.287150 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-acb292cf-78ee-4998-9550-74bdef9aed5b tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:26.290997 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-acb292cf-78ee-4998-9550-74bdef9aed5b tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:26.291988 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-acb292cf-78ee-4998-9550-74bdef9aed5b tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:26.294897 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-acb292cf-78ee-4998-9550-74bdef9aed5b tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:26.388447 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-acb292cf-78ee-4998-9550-74bdef9aed5b tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac264b6684ae4c3f9fc8903163693d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d337ebe3a0475b9331780325e17451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:26.398210 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-acb292cf-78ee-4998-9550-74bdef9aed5b tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] 10.222.0.36 "GET /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a" status: 200 len: 1275 microversion: 2.1 time: 0.128171 Jul 05 13:01:26.410923 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 32/59] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:26 2022] GET /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a => generated 1275 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:01:26.496668 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-04d0076c-7ceb-4379-aa46-d6924d89c47b tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:26.498083 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-04d0076c-7ceb-4379-aa46-d6924d89c47b tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 0f8f2957-1273-413b-ab2b-32da8868f70d] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:26.532277 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-04d0076c-7ceb-4379-aa46-d6924d89c47b tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:26.532480 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-04d0076c-7ceb-4379-aa46-d6924d89c47b tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:26.549285 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-04d0076c-7ceb-4379-aa46-d6924d89c47b tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:26.551458 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-04d0076c-7ceb-4379-aa46-d6924d89c47b tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:26.786687 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-04d0076c-7ceb-4379-aa46-d6924d89c47b tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:26.799742 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-04d0076c-7ceb-4379-aa46-d6924d89c47b tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d" status: 200 len: 1294 microversion: 2.1 time: 0.305729 Jul 05 13:01:26.804971 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 28/60] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:26 2022] GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d => generated 1294 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:01:26.891797 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-110986a7-bd23-4a3b-b94f-cf44d994c021 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:26.893172 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-4d35bd56-3796-4a5a-b95c-3d3469946fe3 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:26.894069 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-110986a7-bd23-4a3b-b94f-cf44d994c021 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:26.894995 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-4d35bd56-3796-4a5a-b95c-3d3469946fe3 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:26.960042 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-4d35bd56-3796-4a5a-b95c-3d3469946fe3 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:26.960042 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-4d35bd56-3796-4a5a-b95c-3d3469946fe3 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:26.960220 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-110986a7-bd23-4a3b-b94f-cf44d994c021 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:26.960220 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-110986a7-bd23-4a3b-b94f-cf44d994c021 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:26.961082 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-110986a7-bd23-4a3b-b94f-cf44d994c021 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:26.969316 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-4d35bd56-3796-4a5a-b95c-3d3469946fe3 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:26.970510 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-110986a7-bd23-4a3b-b94f-cf44d994c021 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:26.973382 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-4d35bd56-3796-4a5a-b95c-3d3469946fe3 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:27.492801 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-4d35bd56-3796-4a5a-b95c-3d3469946fe3 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:27.505183 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-4d35bd56-3796-4a5a-b95c-3d3469946fe3 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1282 microversion: 2.1 time: 0.633630 Jul 05 13:01:27.521786 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 33/61] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:26 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1282 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:01:27.527486 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-fb037994-98f7-4a9f-8a42-6d4ae0456fff tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:27.543642 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-fb037994-98f7-4a9f-8a42-6d4ae0456fff tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] [instance: 60d29496-d306-4d93-b1ca-23afb86dd55a] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:27.567151 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-fb037994-98f7-4a9f-8a42-6d4ae0456fff tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:27.567712 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-fb037994-98f7-4a9f-8a42-6d4ae0456fff tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:27.569823 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-fb037994-98f7-4a9f-8a42-6d4ae0456fff tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:27.569823 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-fb037994-98f7-4a9f-8a42-6d4ae0456fff tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:27.651292 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-110986a7-bd23-4a3b-b94f-cf44d994c021 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:27.651292 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-110986a7-bd23-4a3b-b94f-cf44d994c021 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:27.652816 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-110986a7-bd23-4a3b-b94f-cf44d994c021 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:27.662174 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-110986a7-bd23-4a3b-b94f-cf44d994c021 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1340 microversion: 2.20 time: 0.769140 Jul 05 13:01:27.663037 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 29/62] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:01:26 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1340 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:01:27.821567 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-3366612c-71c6-4731-9ec6-d76c749dd699 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:27.823508 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-3366612c-71c6-4731-9ec6-d76c749dd699 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 0f8f2957-1273-413b-ab2b-32da8868f70d] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:27.839058 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-fb037994-98f7-4a9f-8a42-6d4ae0456fff tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac264b6684ae4c3f9fc8903163693d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d337ebe3a0475b9331780325e17451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:27.842916 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3366612c-71c6-4731-9ec6-d76c749dd699 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:27.845488 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3366612c-71c6-4731-9ec6-d76c749dd699 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:27.847978 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3366612c-71c6-4731-9ec6-d76c749dd699 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:27.848562 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3366612c-71c6-4731-9ec6-d76c749dd699 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:27.856917 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-fb037994-98f7-4a9f-8a42-6d4ae0456fff tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] 10.222.0.36 "GET /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a" status: 200 len: 1273 microversion: 2.1 time: 0.330638 Jul 05 13:01:27.867781 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 34/63] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:27 2022] GET /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a => generated 1273 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:01:28.154910 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-3366612c-71c6-4731-9ec6-d76c749dd699 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:28.163349 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-3366612c-71c6-4731-9ec6-d76c749dd699 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d" status: 200 len: 1300 microversion: 2.1 time: 0.349177 Jul 05 13:01:28.184702 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 30/64] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:27 2022] GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d => generated 1300 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:01:28.540783 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-43ee546c-b32b-4c61-b200-6cc3fec8b8c8 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:28.541398 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-43ee546c-b32b-4c61-b200-6cc3fec8b8c8 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:28.550743 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-43ee546c-b32b-4c61-b200-6cc3fec8b8c8 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:28.554064 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-43ee546c-b32b-4c61-b200-6cc3fec8b8c8 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:28.554064 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-43ee546c-b32b-4c61-b200-6cc3fec8b8c8 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:28.557504 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-43ee546c-b32b-4c61-b200-6cc3fec8b8c8 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:28.691402 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-77bf3663-cf5c-42c8-8fb0-0f6f95a76e72 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:28.692018 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-77bf3663-cf5c-42c8-8fb0-0f6f95a76e72 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:28.699784 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-77bf3663-cf5c-42c8-8fb0-0f6f95a76e72 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:28.702033 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-77bf3663-cf5c-42c8-8fb0-0f6f95a76e72 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:28.702033 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-77bf3663-cf5c-42c8-8fb0-0f6f95a76e72 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:28.702033 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-77bf3663-cf5c-42c8-8fb0-0f6f95a76e72 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:28.898004 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-43ee546c-b32b-4c61-b200-6cc3fec8b8c8 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:28.928340 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-43ee546c-b32b-4c61-b200-6cc3fec8b8c8 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1280 microversion: 2.1 time: 0.392337 Jul 05 13:01:28.928976 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 35/65] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:28 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1280 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:01:28.940483 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-aebe192b-06c9-40c8-8c13-e976d66b2f3a tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:28.940483 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-aebe192b-06c9-40c8-8c13-e976d66b2f3a tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] [instance: 60d29496-d306-4d93-b1ca-23afb86dd55a] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:28.956900 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-aebe192b-06c9-40c8-8c13-e976d66b2f3a tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:28.957423 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-aebe192b-06c9-40c8-8c13-e976d66b2f3a tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:28.958207 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-aebe192b-06c9-40c8-8c13-e976d66b2f3a tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:28.958638 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-aebe192b-06c9-40c8-8c13-e976d66b2f3a tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:29.289739 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-77bf3663-cf5c-42c8-8fb0-0f6f95a76e72 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:29.304192 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-77bf3663-cf5c-42c8-8fb0-0f6f95a76e72 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:29.313501 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-77bf3663-cf5c-42c8-8fb0-0f6f95a76e72 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:29.317444 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-77bf3663-cf5c-42c8-8fb0-0f6f95a76e72 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1407 microversion: 2.20 time: 0.629908 Jul 05 13:01:29.318136 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 31/66] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:01:28 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1407 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 13:01:29.332931 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-f8008df3-5598-47a3-809b-9b490054f41f tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:29.335346 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-f8008df3-5598-47a3-809b-9b490054f41f tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 0f8f2957-1273-413b-ab2b-32da8868f70d] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:29.372268 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f8008df3-5598-47a3-809b-9b490054f41f tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:29.373130 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f8008df3-5598-47a3-809b-9b490054f41f tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:29.377259 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f8008df3-5598-47a3-809b-9b490054f41f tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:29.378238 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f8008df3-5598-47a3-809b-9b490054f41f tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:29.935930 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-aebe192b-06c9-40c8-8c13-e976d66b2f3a tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac264b6684ae4c3f9fc8903163693d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d337ebe3a0475b9331780325e17451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:29.957633 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-aebe192b-06c9-40c8-8c13-e976d66b2f3a tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] 10.222.0.36 "GET /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a" status: 200 len: 1273 microversion: 2.1 time: 1.015759 Jul 05 13:01:29.957633 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 36/67] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:28 2022] GET /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a => generated 1273 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:01:29.962019 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-261c6c53-97fa-414f-8cc2-5f95ab78acaf tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:29.965768 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-261c6c53-97fa-414f-8cc2-5f95ab78acaf tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:29.975613 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-f8008df3-5598-47a3-809b-9b490054f41f tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:29.983241 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-261c6c53-97fa-414f-8cc2-5f95ab78acaf tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:29.984367 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-261c6c53-97fa-414f-8cc2-5f95ab78acaf tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:29.986331 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-261c6c53-97fa-414f-8cc2-5f95ab78acaf tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:29.988960 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-261c6c53-97fa-414f-8cc2-5f95ab78acaf tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:29.997903 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-f8008df3-5598-47a3-809b-9b490054f41f tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d" status: 200 len: 1300 microversion: 2.1 time: 0.667891 Jul 05 13:01:29.997903 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 32/68] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:29 2022] GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d => generated 1300 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:01:30.277622 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_cell0:SELECT=6 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:30.338404 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-4211a8c2-5a97-4a57-92e7-3f5fa9ac03f5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:30.339290 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-4211a8c2-5a97-4a57-92e7-3f5fa9ac03f5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:30.341404 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell0:SELECT=4 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:30.342364 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell0:SELECT=20 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:30.364243 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-261c6c53-97fa-414f-8cc2-5f95ab78acaf tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:30.377209 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4211a8c2-5a97-4a57-92e7-3f5fa9ac03f5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:30.377679 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4211a8c2-5a97-4a57-92e7-3f5fa9ac03f5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:30.386858 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4211a8c2-5a97-4a57-92e7-3f5fa9ac03f5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:30.386858 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4211a8c2-5a97-4a57-92e7-3f5fa9ac03f5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:30.387843 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-261c6c53-97fa-414f-8cc2-5f95ab78acaf tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1280 microversion: 2.1 time: 0.439842 Jul 05 13:01:30.391489 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 37/69] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:29 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1280 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:01:30.791704 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-4211a8c2-5a97-4a57-92e7-3f5fa9ac03f5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:30.812978 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-4211a8c2-5a97-4a57-92e7-3f5fa9ac03f5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:30.818561 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-4211a8c2-5a97-4a57-92e7-3f5fa9ac03f5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:30.819413 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-4211a8c2-5a97-4a57-92e7-3f5fa9ac03f5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1407 microversion: 2.20 time: 0.486800 Jul 05 13:01:30.840845 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 33/70] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:01:30 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1407 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 13:01:30.967360 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-90874bed-2774-486b-9558-8f6893035725 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:30.967978 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-90874bed-2774-486b-9558-8f6893035725 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] [instance: 60d29496-d306-4d93-b1ca-23afb86dd55a] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:30.980891 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-90874bed-2774-486b-9558-8f6893035725 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:30.982278 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-90874bed-2774-486b-9558-8f6893035725 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:30.984196 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-90874bed-2774-486b-9558-8f6893035725 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:30.987663 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-90874bed-2774-486b-9558-8f6893035725 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:31.010705 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-9468ae47-c331-4301-a672-6a3ca444bf77 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:31.011336 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-9468ae47-c331-4301-a672-6a3ca444bf77 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 0f8f2957-1273-413b-ab2b-32da8868f70d] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:31.032134 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9468ae47-c331-4301-a672-6a3ca444bf77 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:31.032888 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9468ae47-c331-4301-a672-6a3ca444bf77 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:31.033884 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9468ae47-c331-4301-a672-6a3ca444bf77 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:31.036828 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9468ae47-c331-4301-a672-6a3ca444bf77 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:31.981322 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_cell0:SELECT=32 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:32.108229 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-9468ae47-c331-4301-a672-6a3ca444bf77 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:32.124052 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell1:SELECT=100 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:32.128496 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-9468ae47-c331-4301-a672-6a3ca444bf77 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d" status: 200 len: 1300 microversion: 2.1 time: 1.122709 Jul 05 13:01:32.146707 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 34/71] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:31 2022] GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d => generated 1300 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:01:32.159708 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-dd24e509-4ef8-4756-98b9-c8f36b7c6a5f tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:32.159708 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-dd24e509-4ef8-4756-98b9-c8f36b7c6a5f tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:32.171344 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-dd24e509-4ef8-4756-98b9-c8f36b7c6a5f tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:32.173515 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-dd24e509-4ef8-4756-98b9-c8f36b7c6a5f tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:32.176016 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-dd24e509-4ef8-4756-98b9-c8f36b7c6a5f tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:32.176799 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-dd24e509-4ef8-4756-98b9-c8f36b7c6a5f tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:32.402172 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-dd24e509-4ef8-4756-98b9-c8f36b7c6a5f tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:32.409899 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-dd24e509-4ef8-4756-98b9-c8f36b7c6a5f tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1280 microversion: 2.1 time: 0.259847 Jul 05 13:01:32.427536 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 35/72] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:32 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1280 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:01:32.433996 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-7ebdbf70-d56c-4023-864f-c3eedfec2cd6 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:32.444948 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-7ebdbf70-d56c-4023-864f-c3eedfec2cd6 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:32.461975 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7ebdbf70-d56c-4023-864f-c3eedfec2cd6 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:32.468977 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7ebdbf70-d56c-4023-864f-c3eedfec2cd6 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:32.470907 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7ebdbf70-d56c-4023-864f-c3eedfec2cd6 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:32.472796 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7ebdbf70-d56c-4023-864f-c3eedfec2cd6 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:32.742621 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-90874bed-2774-486b-9558-8f6893035725 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac264b6684ae4c3f9fc8903163693d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d337ebe3a0475b9331780325e17451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:32.778199 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-90874bed-2774-486b-9558-8f6893035725 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] 10.222.0.36 "GET /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a" status: 200 len: 1315 microversion: 2.1 time: 1.816190 Jul 05 13:01:32.783532 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 38/73] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:30 2022] GET /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a => generated 1315 bytes in 1820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:01:33.152462 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-7ebdbf70-d56c-4023-864f-c3eedfec2cd6 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:33.174003 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-7ebdbf70-d56c-4023-864f-c3eedfec2cd6 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:33.184018 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-7ebdbf70-d56c-4023-864f-c3eedfec2cd6 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:33.187923 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-7ebdbf70-d56c-4023-864f-c3eedfec2cd6 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1407 microversion: 2.20 time: 0.758238 Jul 05 13:01:33.188542 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 36/74] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:01:32 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1407 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:01:33.213142 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-c16ae353-9faf-4da2-8f45-8ab48475a1cc tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:33.214747 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-c16ae353-9faf-4da2-8f45-8ab48475a1cc tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 0f8f2957-1273-413b-ab2b-32da8868f70d] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:33.254685 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c16ae353-9faf-4da2-8f45-8ab48475a1cc tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:33.254685 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c16ae353-9faf-4da2-8f45-8ab48475a1cc tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:33.254685 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c16ae353-9faf-4da2-8f45-8ab48475a1cc tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:33.254685 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c16ae353-9faf-4da2-8f45-8ab48475a1cc tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:33.423688 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [req-3ed1e2ee-5dae-48ab-9449-36e90ddb21e7 req-8ac896e6-dab3-4a6a-adca-116ee89d821f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72285b0b-7735-422b-b110-ef7b03fb367f", "tag": "caf3b4b2-126a-423d-b8ca-4680670bb511"}]} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:01:33.474367 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-3ed1e2ee-5dae-48ab-9449-36e90ddb21e7 req-8ac896e6-dab3-4a6a-adca-116ee89d821f service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:33.474367 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-3ed1e2ee-5dae-48ab-9449-36e90ddb21e7 req-8ac896e6-dab3-4a6a-adca-116ee89d821f service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:33.553380 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.compute.server_external_events [req-3ed1e2ee-5dae-48ab-9449-36e90ddb21e7 req-8ac896e6-dab3-4a6a-adca-116ee89d821f service nova] Creating event network-changed:caf3b4b2-126a-423d-b8ca-4680670bb511 for instance 72285b0b-7735-422b-b110-ef7b03fb367f on hv-cinder-79760 Jul 05 13:01:33.571179 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-3ed1e2ee-5dae-48ab-9449-36e90ddb21e7 req-8ac896e6-dab3-4a6a-adca-116ee89d821f service nova] Acquired lock "compute-rpcapi-router" {{(pid=118386) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 05 13:01:33.572492 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-cbc2a695-7aa6-49f4-a7c6-546b09e22ace None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:33.574950 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-cbc2a695-7aa6-49f4-a7c6-546b09e22ace None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:33.575832 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-cbc2a695-7aa6-49f4-a7c6-546b09e22ace None None] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:33.585057 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-cbc2a695-7aa6-49f4-a7c6-546b09e22ace None None] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:33.642312 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.compute.rpcapi [None req-cbc2a695-7aa6-49f4-a7c6-546b09e22ace None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 05 13:01:33.643221 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-cbc2a695-7aa6-49f4-a7c6-546b09e22ace None None] Releasing lock "compute-rpcapi-router" {{(pid=118386) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 05 13:01:33.697601 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-cbc2a695-7aa6-49f4-a7c6-546b09e22ace None None] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.912447 Jul 05 13:01:33.700224 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 39/75] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:01:33.705940 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-39c770c5-8ae2-4099-a160-c5c3cde6f2d3 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:33.711808 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-39c770c5-8ae2-4099-a160-c5c3cde6f2d3 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:33.712103 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-c16ae353-9faf-4da2-8f45-8ab48475a1cc tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:33.722583 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-c16ae353-9faf-4da2-8f45-8ab48475a1cc tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d" status: 200 len: 1367 microversion: 2.1 time: 0.528048 Jul 05 13:01:33.735392 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 37/76] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:33 2022] GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d => generated 1367 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:01:33.737568 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-39c770c5-8ae2-4099-a160-c5c3cde6f2d3 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:33.738039 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-39c770c5-8ae2-4099-a160-c5c3cde6f2d3 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:33.740616 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-39c770c5-8ae2-4099-a160-c5c3cde6f2d3 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:33.740616 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-39c770c5-8ae2-4099-a160-c5c3cde6f2d3 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:33.797693 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-c5f00537-9344-4311-be18-8c3eea56fe2c tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:33.798313 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-c5f00537-9344-4311-be18-8c3eea56fe2c tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] [instance: 60d29496-d306-4d93-b1ca-23afb86dd55a] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:33.810747 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c5f00537-9344-4311-be18-8c3eea56fe2c tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:33.811204 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c5f00537-9344-4311-be18-8c3eea56fe2c tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:33.811995 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c5f00537-9344-4311-be18-8c3eea56fe2c tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:33.812435 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c5f00537-9344-4311-be18-8c3eea56fe2c tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:34.253357 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-39c770c5-8ae2-4099-a160-c5c3cde6f2d3 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:34.261011 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_cell1:SELECT=100 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:34.264908 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-39c770c5-8ae2-4099-a160-c5c3cde6f2d3 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1322 microversion: 2.1 time: 0.563131 Jul 05 13:01:34.269330 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 40/77] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:33 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1322 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:01:34.274791 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-421f6da2-12da-4c35-8c40-2c7f2318bbf9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:34.282532 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-421f6da2-12da-4c35-8c40-2c7f2318bbf9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:34.296121 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-421f6da2-12da-4c35-8c40-2c7f2318bbf9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:34.297042 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-421f6da2-12da-4c35-8c40-2c7f2318bbf9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:34.303563 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-421f6da2-12da-4c35-8c40-2c7f2318bbf9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:34.303563 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-421f6da2-12da-4c35-8c40-2c7f2318bbf9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:34.439619 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-c5f00537-9344-4311-be18-8c3eea56fe2c tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac264b6684ae4c3f9fc8903163693d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d337ebe3a0475b9331780325e17451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:34.447656 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-c5f00537-9344-4311-be18-8c3eea56fe2c tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] 10.222.0.36 "GET /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a" status: 200 len: 1315 microversion: 2.1 time: 0.653684 Jul 05 13:01:34.460144 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 38/78] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:33 2022] GET /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a => generated 1315 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:01:34.615044 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-421f6da2-12da-4c35-8c40-2c7f2318bbf9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:34.627183 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-421f6da2-12da-4c35-8c40-2c7f2318bbf9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:34.629952 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-421f6da2-12da-4c35-8c40-2c7f2318bbf9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:34.631352 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-421f6da2-12da-4c35-8c40-2c7f2318bbf9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1407 microversion: 2.20 time: 0.360651 Jul 05 13:01:34.632121 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 41/79] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:01:34 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1407 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:01:34.746989 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-275855dc-7d88-463d-aedd-e2cf0b5fc35a tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:34.747668 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-275855dc-7d88-463d-aedd-e2cf0b5fc35a tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 0f8f2957-1273-413b-ab2b-32da8868f70d] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:34.762211 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-275855dc-7d88-463d-aedd-e2cf0b5fc35a tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:34.763391 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-275855dc-7d88-463d-aedd-e2cf0b5fc35a tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:34.765161 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-275855dc-7d88-463d-aedd-e2cf0b5fc35a tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:34.767721 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-275855dc-7d88-463d-aedd-e2cf0b5fc35a tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:35.096712 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-48873c06-df07-4206-9400-6682e34aac88 req-0b719724-fd15-4979-b42e-9ff3b3442e84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d17971e-35b1-437a-baca-1306740b41c0", "tag": "eec25597-9a2b-4423-aabf-e5608c88a606"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:01:35.122040 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-48873c06-df07-4206-9400-6682e34aac88 req-0b719724-fd15-4979-b42e-9ff3b3442e84 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:35.122983 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-48873c06-df07-4206-9400-6682e34aac88 req-0b719724-fd15-4979-b42e-9ff3b3442e84 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:35.170442 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-48873c06-df07-4206-9400-6682e34aac88 req-0b719724-fd15-4979-b42e-9ff3b3442e84 service nova] Creating event network-changed:eec25597-9a2b-4423-aabf-e5608c88a606 for instance 2d17971e-35b1-437a-baca-1306740b41c0 on hv-cinder-79760 Jul 05 13:01:35.178147 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-48873c06-df07-4206-9400-6682e34aac88 req-0b719724-fd15-4979-b42e-9ff3b3442e84 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118387) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 05 13:01:35.180800 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3a975cfe-a0a5-441d-b86e-9bb2d7ca4b7c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:35.186764 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3a975cfe-a0a5-441d-b86e-9bb2d7ca4b7c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:35.186764 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3a975cfe-a0a5-441d-b86e-9bb2d7ca4b7c None None] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:35.186764 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3a975cfe-a0a5-441d-b86e-9bb2d7ca4b7c None None] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:35.205420 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.compute.rpcapi [None req-3a975cfe-a0a5-441d-b86e-9bb2d7ca4b7c None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 05 13:01:35.207231 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3a975cfe-a0a5-441d-b86e-9bb2d7ca4b7c None None] Releasing lock "compute-rpcapi-router" {{(pid=118387) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 05 13:01:35.238724 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-3a975cfe-a0a5-441d-b86e-9bb2d7ca4b7c None None] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.644528 Jul 05 13:01:35.239346 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 39/80] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 13:01:35.286544 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-5f55e080-599e-4f64-81a5-38587ff983cc tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:35.291828 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-5f55e080-599e-4f64-81a5-38587ff983cc tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:35.298686 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5f55e080-599e-4f64-81a5-38587ff983cc tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:35.299619 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5f55e080-599e-4f64-81a5-38587ff983cc tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:35.300394 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5f55e080-599e-4f64-81a5-38587ff983cc tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:35.300891 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5f55e080-599e-4f64-81a5-38587ff983cc tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:35.530117 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-275855dc-7d88-463d-aedd-e2cf0b5fc35a tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:35.573290 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-275855dc-7d88-463d-aedd-e2cf0b5fc35a tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d" status: 200 len: 1367 microversion: 2.1 time: 0.820090 Jul 05 13:01:35.573290 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 42/81] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:34 2022] GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d => generated 1367 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:01:35.587725 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-9860d475-8692-499e-8841-ab533a797919 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:35.591482 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-9860d475-8692-499e-8841-ab533a797919 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] [instance: 60d29496-d306-4d93-b1ca-23afb86dd55a] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:35.607642 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-9860d475-8692-499e-8841-ab533a797919 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:35.611145 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-9860d475-8692-499e-8841-ab533a797919 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:35.612791 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-9860d475-8692-499e-8841-ab533a797919 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:35.614861 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-9860d475-8692-499e-8841-ab533a797919 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:36.145709 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-5f55e080-599e-4f64-81a5-38587ff983cc tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:36.165806 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-5f55e080-599e-4f64-81a5-38587ff983cc tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1322 microversion: 2.1 time: 0.880156 Jul 05 13:01:36.165806 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 40/82] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:35 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1322 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:01:36.175711 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-ecbfd4b5-cb34-4d92-aa99-954f820aa77a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:36.177247 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-ecbfd4b5-cb34-4d92-aa99-954f820aa77a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:36.180918 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:36.188417 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ecbfd4b5-cb34-4d92-aa99-954f820aa77a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:36.189007 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ecbfd4b5-cb34-4d92-aa99-954f820aa77a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:36.189789 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ecbfd4b5-cb34-4d92-aa99-954f820aa77a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:36.193281 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ecbfd4b5-cb34-4d92-aa99-954f820aa77a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:36.525803 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-9860d475-8692-499e-8841-ab533a797919 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac264b6684ae4c3f9fc8903163693d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d337ebe3a0475b9331780325e17451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:36.533643 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-9860d475-8692-499e-8841-ab533a797919 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] 10.222.0.36 "GET /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a" status: 200 len: 1315 microversion: 2.1 time: 0.964519 Jul 05 13:01:36.534505 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 43/83] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:35 2022] GET /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a => generated 1315 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:01:36.582132 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-5c781562-f902-496c-87bf-37eee10b2f16 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:36.582967 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-5c781562-f902-496c-87bf-37eee10b2f16 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 0f8f2957-1273-413b-ab2b-32da8868f70d] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:36.594398 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-5c781562-f902-496c-87bf-37eee10b2f16 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:36.595121 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-5c781562-f902-496c-87bf-37eee10b2f16 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:36.596062 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-5c781562-f902-496c-87bf-37eee10b2f16 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:36.598748 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-5c781562-f902-496c-87bf-37eee10b2f16 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:36.716141 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-ecbfd4b5-cb34-4d92-aa99-954f820aa77a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:36.727095 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-ecbfd4b5-cb34-4d92-aa99-954f820aa77a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:36.732446 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-ecbfd4b5-cb34-4d92-aa99-954f820aa77a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:36.738228 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-ecbfd4b5-cb34-4d92-aa99-954f820aa77a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1407 microversion: 2.20 time: 0.572964 Jul 05 13:01:36.739352 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 41/84] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:01:36 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1407 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:01:37.180645 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-72acb964-3b47-4467-8435-5c9705d1e0c6 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:37.182008 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-72acb964-3b47-4467-8435-5c9705d1e0c6 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:37.202624 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-72acb964-3b47-4467-8435-5c9705d1e0c6 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:37.203328 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-72acb964-3b47-4467-8435-5c9705d1e0c6 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:37.204309 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-72acb964-3b47-4467-8435-5c9705d1e0c6 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:37.204970 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-72acb964-3b47-4467-8435-5c9705d1e0c6 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:37.432557 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-5c781562-f902-496c-87bf-37eee10b2f16 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:37.451235 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-5c781562-f902-496c-87bf-37eee10b2f16 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d" status: 200 len: 1367 microversion: 2.1 time: 0.872700 Jul 05 13:01:37.465657 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 44/85] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:36 2022] GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d => generated 1367 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:01:37.466018 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-72acb964-3b47-4467-8435-5c9705d1e0c6 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:37.476412 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [req-aea55393-b113-45b7-978f-8f0bdda81264 req-31a5f6a2-5abe-45b1-9e63-1a79393d35e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60d29496-d306-4d93-b1ca-23afb86dd55a", "tag": "41a618a8-294c-42b1-90ce-4aa0a088ade4"}]} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:01:37.476961 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-72acb964-3b47-4467-8435-5c9705d1e0c6 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1322 microversion: 2.1 time: 0.299981 Jul 05 13:01:37.477863 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 42/86] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:37 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1322 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:01:37.511078 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-aea55393-b113-45b7-978f-8f0bdda81264 req-31a5f6a2-5abe-45b1-9e63-1a79393d35e7 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:37.511553 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-aea55393-b113-45b7-978f-8f0bdda81264 req-31a5f6a2-5abe-45b1-9e63-1a79393d35e7 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:37.544466 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.compute.server_external_events [req-aea55393-b113-45b7-978f-8f0bdda81264 req-31a5f6a2-5abe-45b1-9e63-1a79393d35e7 service nova] Creating event network-changed:41a618a8-294c-42b1-90ce-4aa0a088ade4 for instance 60d29496-d306-4d93-b1ca-23afb86dd55a on hv-cinder-79760 Jul 05 13:01:37.551396 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-6527b244-a3fe-4ed2-872b-3532debf25be tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:37.552024 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-6527b244-a3fe-4ed2-872b-3532debf25be tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] [instance: 60d29496-d306-4d93-b1ca-23afb86dd55a] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:37.555235 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [req-aea55393-b113-45b7-978f-8f0bdda81264 req-31a5f6a2-5abe-45b1-9e63-1a79393d35e7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087289 Jul 05 13:01:37.557571 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 45/87] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:01:37.561567 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6527b244-a3fe-4ed2-872b-3532debf25be tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:37.562035 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6527b244-a3fe-4ed2-872b-3532debf25be tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:37.562816 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6527b244-a3fe-4ed2-872b-3532debf25be tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:37.571009 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6527b244-a3fe-4ed2-872b-3532debf25be tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:37.760768 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-30d49472-ae51-44f4-beff-1d603298e3e2 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:37.761784 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-30d49472-ae51-44f4-beff-1d603298e3e2 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:37.786918 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-30d49472-ae51-44f4-beff-1d603298e3e2 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:37.786918 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-30d49472-ae51-44f4-beff-1d603298e3e2 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:37.786918 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-30d49472-ae51-44f4-beff-1d603298e3e2 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:37.786918 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-30d49472-ae51-44f4-beff-1d603298e3e2 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:37.833310 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-6527b244-a3fe-4ed2-872b-3532debf25be tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac264b6684ae4c3f9fc8903163693d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d337ebe3a0475b9331780325e17451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:37.853112 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-6527b244-a3fe-4ed2-872b-3532debf25be tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] 10.222.0.36 "GET /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a" status: 200 len: 1315 microversion: 2.1 time: 0.305145 Jul 05 13:01:37.856702 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 43/88] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:37 2022] GET /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a => generated 1315 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:01:38.084152 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-30d49472-ae51-44f4-beff-1d603298e3e2 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:38.099633 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-30d49472-ae51-44f4-beff-1d603298e3e2 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:38.105128 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-30d49472-ae51-44f4-beff-1d603298e3e2 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:38.109169 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-30d49472-ae51-44f4-beff-1d603298e3e2 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1407 microversion: 2.20 time: 0.353849 Jul 05 13:01:38.120954 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 46/89] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:01:37 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1407 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:01:38.483989 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-5674ba41-a84b-4e25-9bb2-64709c1c2ef8 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:38.488120 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-5674ba41-a84b-4e25-9bb2-64709c1c2ef8 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 0f8f2957-1273-413b-ab2b-32da8868f70d] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:38.518551 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5674ba41-a84b-4e25-9bb2-64709c1c2ef8 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:38.519856 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5674ba41-a84b-4e25-9bb2-64709c1c2ef8 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:38.522067 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5674ba41-a84b-4e25-9bb2-64709c1c2ef8 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:38.524122 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5674ba41-a84b-4e25-9bb2-64709c1c2ef8 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:38.528134 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-9345c123-7569-4ccb-8069-6ec4a7a7d555 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:38.534299 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-9345c123-7569-4ccb-8069-6ec4a7a7d555 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:38.542995 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-9345c123-7569-4ccb-8069-6ec4a7a7d555 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:38.543797 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-9345c123-7569-4ccb-8069-6ec4a7a7d555 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:38.544862 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-9345c123-7569-4ccb-8069-6ec4a7a7d555 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:38.546107 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-9345c123-7569-4ccb-8069-6ec4a7a7d555 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:38.951320 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-9345c123-7569-4ccb-8069-6ec4a7a7d555 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:38.980048 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-9345c123-7569-4ccb-8069-6ec4a7a7d555 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1322 microversion: 2.1 time: 0.469434 Jul 05 13:01:38.983288 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 47/90] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:38 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1322 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:01:38.996480 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-e266a12f-dbc5-48cc-a21f-b614fd878e2c tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:39.002226 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-e266a12f-dbc5-48cc-a21f-b614fd878e2c tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] [instance: 60d29496-d306-4d93-b1ca-23afb86dd55a] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:39.012284 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e266a12f-dbc5-48cc-a21f-b614fd878e2c tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:39.023506 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e266a12f-dbc5-48cc-a21f-b614fd878e2c tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:39.023506 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e266a12f-dbc5-48cc-a21f-b614fd878e2c tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:39.023506 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e266a12f-dbc5-48cc-a21f-b614fd878e2c tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:39.023918 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-5674ba41-a84b-4e25-9bb2-64709c1c2ef8 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:39.033116 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-5674ba41-a84b-4e25-9bb2-64709c1c2ef8 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d" status: 200 len: 1367 microversion: 2.1 time: 0.553229 Jul 05 13:01:39.034416 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 44/91] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:38 2022] GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d => generated 1367 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:01:39.133678 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-fad0e568-f4ed-4ff4-9c64-1ddde7c44441 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:39.134589 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-fad0e568-f4ed-4ff4-9c64-1ddde7c44441 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:39.158591 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-fad0e568-f4ed-4ff4-9c64-1ddde7c44441 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:39.159335 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-fad0e568-f4ed-4ff4-9c64-1ddde7c44441 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:39.160356 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-fad0e568-f4ed-4ff4-9c64-1ddde7c44441 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:39.161270 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-fad0e568-f4ed-4ff4-9c64-1ddde7c44441 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:39.299780 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-e266a12f-dbc5-48cc-a21f-b614fd878e2c tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac264b6684ae4c3f9fc8903163693d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d337ebe3a0475b9331780325e17451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:39.310961 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-e266a12f-dbc5-48cc-a21f-b614fd878e2c tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] 10.222.0.36 "GET /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a" status: 200 len: 1315 microversion: 2.1 time: 0.326208 Jul 05 13:01:39.311955 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 48/92] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:38 2022] GET /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a => generated 1315 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:01:39.404210 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-fad0e568-f4ed-4ff4-9c64-1ddde7c44441 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:39.417028 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-fad0e568-f4ed-4ff4-9c64-1ddde7c44441 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:39.419312 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-fad0e568-f4ed-4ff4-9c64-1ddde7c44441 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:39.421004 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-fad0e568-f4ed-4ff4-9c64-1ddde7c44441 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1407 microversion: 2.20 time: 0.291060 Jul 05 13:01:39.421877 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 45/93] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:01:39 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1407 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:01:39.614125 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [req-179dad9b-e25e-4681-af4b-af1717c112cb req-25130edb-6bfc-41a3-bcdf-305a968259e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f8f2957-1273-413b-ab2b-32da8868f70d", "tag": "ce361f6b-ae21-4c14-aee3-5bdf13b4b44f"}, {"name": "network-changed", "server_uuid": "f896e7e9-27f6-4b6a-899c-ad0e27c88174", "tag": "ce02c625-8d30-42c8-adf6-df23075f0cb7"}]} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:01:39.624179 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-179dad9b-e25e-4681-af4b-af1717c112cb req-25130edb-6bfc-41a3-bcdf-305a968259e2 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:39.624995 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-179dad9b-e25e-4681-af4b-af1717c112cb req-25130edb-6bfc-41a3-bcdf-305a968259e2 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:39.639809 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.compute.server_external_events [req-179dad9b-e25e-4681-af4b-af1717c112cb req-25130edb-6bfc-41a3-bcdf-305a968259e2 service nova] Creating event network-changed:ce361f6b-ae21-4c14-aee3-5bdf13b4b44f for instance 0f8f2957-1273-413b-ab2b-32da8868f70d on hv-cinder-79760 Jul 05 13:01:39.640443 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.compute.server_external_events [req-179dad9b-e25e-4681-af4b-af1717c112cb req-25130edb-6bfc-41a3-bcdf-305a968259e2 service nova] Creating event network-changed:ce02c625-8d30-42c8-adf6-df23075f0cb7 for instance f896e7e9-27f6-4b6a-899c-ad0e27c88174 on hv-cinder-79760 Jul 05 13:01:39.647070 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [req-179dad9b-e25e-4681-af4b-af1717c112cb req-25130edb-6bfc-41a3-bcdf-305a968259e2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.036928 Jul 05 13:01:39.648194 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 49/94] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:01:39 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 13:01:40.000178 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-45a1766d-d0a8-4500-8005-a72798b6cbd4 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:40.001520 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-45a1766d-d0a8-4500-8005-a72798b6cbd4 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:40.032285 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-45a1766d-d0a8-4500-8005-a72798b6cbd4 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:40.035186 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-45a1766d-d0a8-4500-8005-a72798b6cbd4 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:40.037303 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-45a1766d-d0a8-4500-8005-a72798b6cbd4 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:40.039526 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-45a1766d-d0a8-4500-8005-a72798b6cbd4 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:40.051836 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-285d7908-92d6-4640-b2e7-c7446081def4 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:40.052679 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-285d7908-92d6-4640-b2e7-c7446081def4 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 0f8f2957-1273-413b-ab2b-32da8868f70d] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:40.061226 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-285d7908-92d6-4640-b2e7-c7446081def4 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:40.061895 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-285d7908-92d6-4640-b2e7-c7446081def4 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:40.062994 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-285d7908-92d6-4640-b2e7-c7446081def4 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:40.063574 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-285d7908-92d6-4640-b2e7-c7446081def4 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:40.329214 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-285d7908-92d6-4640-b2e7-c7446081def4 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:40.334657 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-45a1766d-d0a8-4500-8005-a72798b6cbd4 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:40.339641 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-285d7908-92d6-4640-b2e7-c7446081def4 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d" status: 200 len: 1367 microversion: 2.1 time: 0.292129 Jul 05 13:01:40.340489 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 50/95] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:40 2022] GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d => generated 1367 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:01:40.344788 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-3f8992de-2a0e-4a01-81e9-9f6218b75364 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:40.345391 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-3f8992de-2a0e-4a01-81e9-9f6218b75364 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] [instance: 60d29496-d306-4d93-b1ca-23afb86dd55a] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:40.347379 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-45a1766d-d0a8-4500-8005-a72798b6cbd4 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1322 microversion: 2.1 time: 0.351770 Jul 05 13:01:40.351763 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-3f8992de-2a0e-4a01-81e9-9f6218b75364 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:40.352914 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-3f8992de-2a0e-4a01-81e9-9f6218b75364 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:40.353850 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-3f8992de-2a0e-4a01-81e9-9f6218b75364 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:40.354436 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-3f8992de-2a0e-4a01-81e9-9f6218b75364 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:40.357366 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 46/96] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:39 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1322 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:01:40.440518 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-827be3bc-c9bf-4dbe-a9aa-f2769f63bf85 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:40.441180 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-827be3bc-c9bf-4dbe-a9aa-f2769f63bf85 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:40.449785 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-827be3bc-c9bf-4dbe-a9aa-f2769f63bf85 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:40.450228 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-827be3bc-c9bf-4dbe-a9aa-f2769f63bf85 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:40.454807 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-827be3bc-c9bf-4dbe-a9aa-f2769f63bf85 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:40.454807 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-827be3bc-c9bf-4dbe-a9aa-f2769f63bf85 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:40.570255 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-3f8992de-2a0e-4a01-81e9-9f6218b75364 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac264b6684ae4c3f9fc8903163693d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d337ebe3a0475b9331780325e17451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:40.582954 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-3f8992de-2a0e-4a01-81e9-9f6218b75364 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] 10.222.0.36 "GET /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a" status: 200 len: 1315 microversion: 2.1 time: 0.241624 Jul 05 13:01:40.584272 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 51/97] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:40 2022] GET /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:01:40.672538 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-827be3bc-c9bf-4dbe-a9aa-f2769f63bf85 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:40.681988 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-827be3bc-c9bf-4dbe-a9aa-f2769f63bf85 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:40.683751 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-827be3bc-c9bf-4dbe-a9aa-f2769f63bf85 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:40.685392 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-827be3bc-c9bf-4dbe-a9aa-f2769f63bf85 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1407 microversion: 2.20 time: 0.248952 Jul 05 13:01:40.697272 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 47/98] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:01:40 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1407 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:01:41.356987 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-4aef55d9-06f5-46ae-960d-2b50d592f804 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:41.357592 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-4aef55d9-06f5-46ae-960d-2b50d592f804 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 0f8f2957-1273-413b-ab2b-32da8868f70d] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:41.365545 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-91435253-4fc3-4a99-a5c7-1653f4595ad9 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:41.366156 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-91435253-4fc3-4a99-a5c7-1653f4595ad9 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:41.372742 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-4aef55d9-06f5-46ae-960d-2b50d592f804 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:41.373190 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-4aef55d9-06f5-46ae-960d-2b50d592f804 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:41.373953 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-4aef55d9-06f5-46ae-960d-2b50d592f804 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:41.374246 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-91435253-4fc3-4a99-a5c7-1653f4595ad9 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:41.374399 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-4aef55d9-06f5-46ae-960d-2b50d592f804 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:41.375077 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-91435253-4fc3-4a99-a5c7-1653f4595ad9 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:41.376273 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-91435253-4fc3-4a99-a5c7-1653f4595ad9 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:41.376974 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-91435253-4fc3-4a99-a5c7-1653f4595ad9 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:41.664049 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-91435253-4fc3-4a99-a5c7-1653f4595ad9 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:41.674155 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-4aef55d9-06f5-46ae-960d-2b50d592f804 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:41.680121 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-91435253-4fc3-4a99-a5c7-1653f4595ad9 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1322 microversion: 2.1 time: 0.318485 Jul 05 13:01:41.682611 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 48/99] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:41 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1322 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:01:41.685601 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-91befe19-85fd-4bde-8750-54d7fce715d7 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:41.686436 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-91befe19-85fd-4bde-8750-54d7fce715d7 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] [instance: 60d29496-d306-4d93-b1ca-23afb86dd55a] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:41.687509 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-4aef55d9-06f5-46ae-960d-2b50d592f804 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d" status: 200 len: 1367 microversion: 2.1 time: 0.334229 Jul 05 13:01:41.688443 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 52/100] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:41 2022] GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d => generated 1367 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:01:41.693386 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-91befe19-85fd-4bde-8750-54d7fce715d7 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:41.694032 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-91befe19-85fd-4bde-8750-54d7fce715d7 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:41.694866 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-91befe19-85fd-4bde-8750-54d7fce715d7 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:41.695327 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-91befe19-85fd-4bde-8750-54d7fce715d7 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:41.704153 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-4b5df4cd-1d07-4515-b27d-ef0199718567 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:41.705423 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-4b5df4cd-1d07-4515-b27d-ef0199718567 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:41.711684 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-4b5df4cd-1d07-4515-b27d-ef0199718567 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:41.712134 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-4b5df4cd-1d07-4515-b27d-ef0199718567 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:41.712952 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-4b5df4cd-1d07-4515-b27d-ef0199718567 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:41.713390 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-4b5df4cd-1d07-4515-b27d-ef0199718567 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:41.924166 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-91befe19-85fd-4bde-8750-54d7fce715d7 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac264b6684ae4c3f9fc8903163693d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d337ebe3a0475b9331780325e17451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:41.941605 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-91befe19-85fd-4bde-8750-54d7fce715d7 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] 10.222.0.36 "GET /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a" status: 200 len: 1315 microversion: 2.1 time: 0.257314 Jul 05 13:01:41.941781 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-4b5df4cd-1d07-4515-b27d-ef0199718567 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:41.942317 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 49/101] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:41 2022] GET /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a => generated 1315 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:01:41.951483 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-4b5df4cd-1d07-4515-b27d-ef0199718567 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:41.953213 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-4b5df4cd-1d07-4515-b27d-ef0199718567 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:41.954330 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-4b5df4cd-1d07-4515-b27d-ef0199718567 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1407 microversion: 2.20 time: 0.254364 Jul 05 13:01:41.954848 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 53/102] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:01:41 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1407 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 13:01:42.697050 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-93f06191-b8a2-494e-9acd-bca74c13777a tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:42.697665 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-93f06191-b8a2-494e-9acd-bca74c13777a tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:42.704116 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-93f06191-b8a2-494e-9acd-bca74c13777a tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:42.704441 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-8cdfaf70-4186-4943-ac6a-a2c7f5633a9c tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:42.704919 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-93f06191-b8a2-494e-9acd-bca74c13777a tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:42.705284 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-8cdfaf70-4186-4943-ac6a-a2c7f5633a9c tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 0f8f2957-1273-413b-ab2b-32da8868f70d] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:42.705492 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-93f06191-b8a2-494e-9acd-bca74c13777a tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:42.705934 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-93f06191-b8a2-494e-9acd-bca74c13777a tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:42.714068 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-8cdfaf70-4186-4943-ac6a-a2c7f5633a9c tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:42.714671 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-8cdfaf70-4186-4943-ac6a-a2c7f5633a9c tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:42.715686 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-8cdfaf70-4186-4943-ac6a-a2c7f5633a9c tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:42.716282 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-8cdfaf70-4186-4943-ac6a-a2c7f5633a9c tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:42.898122 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-93f06191-b8a2-494e-9acd-bca74c13777a tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:42.906064 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-93f06191-b8a2-494e-9acd-bca74c13777a tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1322 microversion: 2.1 time: 0.213512 Jul 05 13:01:42.907416 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 50/103] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:42 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:01:42.910087 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-8cdfaf70-4186-4943-ac6a-a2c7f5633a9c tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:42.917510 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-8cdfaf70-4186-4943-ac6a-a2c7f5633a9c tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d" status: 200 len: 1367 microversion: 2.1 time: 0.216857 Jul 05 13:01:42.922984 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 54/104] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:42 2022] GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:01:42.959020 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-f7e126f8-516a-4f82-adae-2fb7e60ce0c8 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:42.959665 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-f7e126f8-516a-4f82-adae-2fb7e60ce0c8 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] [instance: 60d29496-d306-4d93-b1ca-23afb86dd55a] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:42.965729 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f7e126f8-516a-4f82-adae-2fb7e60ce0c8 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:42.971383 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f7e126f8-516a-4f82-adae-2fb7e60ce0c8 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:42.971383 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f7e126f8-516a-4f82-adae-2fb7e60ce0c8 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:42.971383 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f7e126f8-516a-4f82-adae-2fb7e60ce0c8 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:42.974978 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-7f5e2eab-fc17-498a-941b-8b19854bbc52 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:42.976463 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-7f5e2eab-fc17-498a-941b-8b19854bbc52 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:42.984617 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-7f5e2eab-fc17-498a-941b-8b19854bbc52 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:42.985292 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-7f5e2eab-fc17-498a-941b-8b19854bbc52 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:42.986257 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-7f5e2eab-fc17-498a-941b-8b19854bbc52 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:42.987006 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-7f5e2eab-fc17-498a-941b-8b19854bbc52 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:43.173732 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-f7e126f8-516a-4f82-adae-2fb7e60ce0c8 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac264b6684ae4c3f9fc8903163693d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d337ebe3a0475b9331780325e17451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:43.179031 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell1:SELECT=100 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:43.188030 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-f7e126f8-516a-4f82-adae-2fb7e60ce0c8 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] 10.222.0.36 "GET /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a" status: 200 len: 1315 microversion: 2.1 time: 0.232732 Jul 05 13:01:43.190718 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 51/105] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:42 2022] GET /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:01:43.218802 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-7f5e2eab-fc17-498a-941b-8b19854bbc52 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:43.218802 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-7f5e2eab-fc17-498a-941b-8b19854bbc52 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:43.219138 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-7f5e2eab-fc17-498a-941b-8b19854bbc52 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:43.219138 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-7f5e2eab-fc17-498a-941b-8b19854bbc52 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1407 microversion: 2.20 time: 0.245248 Jul 05 13:01:43.219138 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 55/106] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:01:42 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1407 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 13:01:43.924277 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-82ca6284-6ea0-4180-84e6-132d94418c2c tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:43.924982 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-82ca6284-6ea0-4180-84e6-132d94418c2c tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:43.932894 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-82ca6284-6ea0-4180-84e6-132d94418c2c tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:43.933364 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-82ca6284-6ea0-4180-84e6-132d94418c2c tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:43.934153 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-82ca6284-6ea0-4180-84e6-132d94418c2c tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:43.934594 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-82ca6284-6ea0-4180-84e6-132d94418c2c tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:43.935055 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-c0011865-daa3-4635-b24a-d9c33df65e8b tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:43.935671 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-c0011865-daa3-4635-b24a-d9c33df65e8b tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 0f8f2957-1273-413b-ab2b-32da8868f70d] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:43.938171 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_cell0:SELECT=2 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:43.945106 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-c0011865-daa3-4635-b24a-d9c33df65e8b tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:43.946093 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-c0011865-daa3-4635-b24a-d9c33df65e8b tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:43.947112 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-c0011865-daa3-4635-b24a-d9c33df65e8b tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:43.947881 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-c0011865-daa3-4635-b24a-d9c33df65e8b tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:44.157523 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-82ca6284-6ea0-4180-84e6-132d94418c2c tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:44.166062 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-82ca6284-6ea0-4180-84e6-132d94418c2c tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1322 microversion: 2.1 time: 0.246139 Jul 05 13:01:44.170937 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 52/107] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:43 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1322 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:01:44.174369 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-c0011865-daa3-4635-b24a-d9c33df65e8b tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:44.181891 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-c0011865-daa3-4635-b24a-d9c33df65e8b tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d" status: 200 len: 1367 microversion: 2.1 time: 0.250698 Jul 05 13:01:44.182461 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 56/108] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:43 2022] GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d => generated 1367 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:01:44.244702 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-16420bc0-92d4-4b4c-8f64-ef1f76a44ad5 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:44.245287 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-16420bc0-92d4-4b4c-8f64-ef1f76a44ad5 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] [instance: 60d29496-d306-4d93-b1ca-23afb86dd55a] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:44.246652 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-dc8e2998-cece-4a49-889d-9367b1ad9232 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:44.247491 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-dc8e2998-cece-4a49-889d-9367b1ad9232 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:44.252337 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-16420bc0-92d4-4b4c-8f64-ef1f76a44ad5 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:44.253056 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-16420bc0-92d4-4b4c-8f64-ef1f76a44ad5 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:44.256132 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-16420bc0-92d4-4b4c-8f64-ef1f76a44ad5 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:44.256132 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-16420bc0-92d4-4b4c-8f64-ef1f76a44ad5 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:44.256311 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-dc8e2998-cece-4a49-889d-9367b1ad9232 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:44.256311 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-dc8e2998-cece-4a49-889d-9367b1ad9232 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:44.256973 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-dc8e2998-cece-4a49-889d-9367b1ad9232 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:44.257753 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-dc8e2998-cece-4a49-889d-9367b1ad9232 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:44.487925 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-dc8e2998-cece-4a49-889d-9367b1ad9232 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:44.493665 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-16420bc0-92d4-4b4c-8f64-ef1f76a44ad5 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac264b6684ae4c3f9fc8903163693d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d337ebe3a0475b9331780325e17451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:44.507473 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-dc8e2998-cece-4a49-889d-9367b1ad9232 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:44.509806 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-16420bc0-92d4-4b4c-8f64-ef1f76a44ad5 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] 10.222.0.36 "GET /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a" status: 200 len: 1315 microversion: 2.1 time: 0.268889 Jul 05 13:01:44.510785 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 53/109] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:44 2022] GET /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a => generated 1315 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:01:44.513042 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-dc8e2998-cece-4a49-889d-9367b1ad9232 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:44.515410 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-dc8e2998-cece-4a49-889d-9367b1ad9232 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1407 microversion: 2.20 time: 0.272238 Jul 05 13:01:44.517829 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 57/110] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:01:44 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1407 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:01:45.184959 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-d98d84a6-2fd8-4f54-9a07-1806011bb9d4 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:45.186340 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-d98d84a6-2fd8-4f54-9a07-1806011bb9d4 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:45.199117 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-a9739f69-9117-46eb-94e1-fac794104e1f tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:45.199719 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-a9739f69-9117-46eb-94e1-fac794104e1f tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 0f8f2957-1273-413b-ab2b-32da8868f70d] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:45.207469 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a9739f69-9117-46eb-94e1-fac794104e1f tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:45.207929 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a9739f69-9117-46eb-94e1-fac794104e1f tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:45.208728 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a9739f69-9117-46eb-94e1-fac794104e1f tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:45.209167 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a9739f69-9117-46eb-94e1-fac794104e1f tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:45.212342 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d98d84a6-2fd8-4f54-9a07-1806011bb9d4 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:45.214759 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d98d84a6-2fd8-4f54-9a07-1806011bb9d4 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:45.215584 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d98d84a6-2fd8-4f54-9a07-1806011bb9d4 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:45.216025 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d98d84a6-2fd8-4f54-9a07-1806011bb9d4 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:45.216488 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell0:SELECT=2 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:45.493222 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-d98d84a6-2fd8-4f54-9a07-1806011bb9d4 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:45.494610 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-a9739f69-9117-46eb-94e1-fac794104e1f tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:45.500832 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_cell1:SELECT=100 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:45.504375 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-d98d84a6-2fd8-4f54-9a07-1806011bb9d4 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1322 microversion: 2.1 time: 0.322427 Jul 05 13:01:45.505339 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-a9739f69-9117-46eb-94e1-fac794104e1f tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d" status: 200 len: 1367 microversion: 2.1 time: 0.309990 Jul 05 13:01:45.506100 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 58/111] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:45 2022] GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d => generated 1367 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:01:45.516757 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 54/112] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:45 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1322 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:01:45.531819 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-11d525ad-d4ad-45d0-acb2-881d536aacf3 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:45.532704 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-11d525ad-d4ad-45d0-acb2-881d536aacf3 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] [instance: 60d29496-d306-4d93-b1ca-23afb86dd55a] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:45.540549 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-11d525ad-d4ad-45d0-acb2-881d536aacf3 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:45.540934 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-11d525ad-d4ad-45d0-acb2-881d536aacf3 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:45.542029 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-11d525ad-d4ad-45d0-acb2-881d536aacf3 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:45.542654 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-11d525ad-d4ad-45d0-acb2-881d536aacf3 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:45.545598 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-2ac46ab7-60d3-4617-a6db-8855dff17259 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:45.546251 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-2ac46ab7-60d3-4617-a6db-8855dff17259 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:45.555149 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2ac46ab7-60d3-4617-a6db-8855dff17259 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:45.555830 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2ac46ab7-60d3-4617-a6db-8855dff17259 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:45.556617 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2ac46ab7-60d3-4617-a6db-8855dff17259 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:45.557060 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2ac46ab7-60d3-4617-a6db-8855dff17259 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:45.807806 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-11d525ad-d4ad-45d0-acb2-881d536aacf3 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac264b6684ae4c3f9fc8903163693d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d337ebe3a0475b9331780325e17451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:45.821417 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-11d525ad-d4ad-45d0-acb2-881d536aacf3 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] 10.222.0.36 "GET /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a" status: 200 len: 1315 microversion: 2.1 time: 0.293473 Jul 05 13:01:45.827947 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-2ac46ab7-60d3-4617-a6db-8855dff17259 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:45.830909 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 59/113] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:45 2022] GET /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a => generated 1315 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:01:45.844081 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-2ac46ab7-60d3-4617-a6db-8855dff17259 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:45.860713 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-2ac46ab7-60d3-4617-a6db-8855dff17259 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:45.860713 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-2ac46ab7-60d3-4617-a6db-8855dff17259 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1407 microversion: 2.20 time: 0.305955 Jul 05 13:01:45.860713 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 55/114] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:01:45 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1407 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:01:46.346013 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [req-16d968d8-0aa7-4857-820f-28780917aed5 req-612f183e-4dc8-423a-adcb-984c5acbc100 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d17971e-35b1-437a-baca-1306740b41c0", "name": "network-vif-plugged", "status": "completed", "tag": "eec25597-9a2b-4423-aabf-e5608c88a606"}]} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:01:46.355101 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-16d968d8-0aa7-4857-820f-28780917aed5 req-612f183e-4dc8-423a-adcb-984c5acbc100 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:46.355767 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-16d968d8-0aa7-4857-820f-28780917aed5 req-612f183e-4dc8-423a-adcb-984c5acbc100 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:46.378544 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.compute.server_external_events [req-16d968d8-0aa7-4857-820f-28780917aed5 req-612f183e-4dc8-423a-adcb-984c5acbc100 service nova] Creating event network-vif-plugged:eec25597-9a2b-4423-aabf-e5608c88a606 for instance 2d17971e-35b1-437a-baca-1306740b41c0 on hv-cinder-79760 Jul 05 13:01:46.385602 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [req-16d968d8-0aa7-4857-820f-28780917aed5 req-612f183e-4dc8-423a-adcb-984c5acbc100 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132797 Jul 05 13:01:46.387105 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 60/115] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:01:46.523030 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-f3f6185f-7f04-4870-94cf-db0ecc39aaab tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:46.523640 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-f3f6185f-7f04-4870-94cf-db0ecc39aaab tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:46.533979 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f3f6185f-7f04-4870-94cf-db0ecc39aaab tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:46.534429 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f3f6185f-7f04-4870-94cf-db0ecc39aaab tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:46.535191 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f3f6185f-7f04-4870-94cf-db0ecc39aaab tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:46.536099 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-5839f829-0cbe-4513-b525-fb34d0498be8 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:46.536402 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f3f6185f-7f04-4870-94cf-db0ecc39aaab tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:46.537635 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-5839f829-0cbe-4513-b525-fb34d0498be8 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 0f8f2957-1273-413b-ab2b-32da8868f70d] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:46.549486 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-5839f829-0cbe-4513-b525-fb34d0498be8 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:46.550454 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-5839f829-0cbe-4513-b525-fb34d0498be8 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:46.551531 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-5839f829-0cbe-4513-b525-fb34d0498be8 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:46.552098 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-5839f829-0cbe-4513-b525-fb34d0498be8 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:46.839173 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-5839f829-0cbe-4513-b525-fb34d0498be8 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:46.850269 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-5839f829-0cbe-4513-b525-fb34d0498be8 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d" status: 200 len: 1367 microversion: 2.1 time: 0.320112 Jul 05 13:01:46.852847 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 61/116] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:46 2022] GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d => generated 1367 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:01:46.855448 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-f3f6185f-7f04-4870-94cf-db0ecc39aaab tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:46.865218 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-579e4382-c829-47e8-8419-3b8fcc3bfe08 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:46.866762 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-f3f6185f-7f04-4870-94cf-db0ecc39aaab tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1322 microversion: 2.1 time: 0.347471 Jul 05 13:01:46.867459 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-579e4382-c829-47e8-8419-3b8fcc3bfe08 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] [instance: 60d29496-d306-4d93-b1ca-23afb86dd55a] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:46.876801 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-579e4382-c829-47e8-8419-3b8fcc3bfe08 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:46.876801 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-579e4382-c829-47e8-8419-3b8fcc3bfe08 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:46.877497 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 56/117] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:46 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1322 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:01:46.877964 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-579e4382-c829-47e8-8419-3b8fcc3bfe08 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:46.878621 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-579e4382-c829-47e8-8419-3b8fcc3bfe08 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:46.883403 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-799c5abf-8e94-46c6-b140-560554a8fddb tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:46.884422 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-799c5abf-8e94-46c6-b140-560554a8fddb tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:46.890917 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-799c5abf-8e94-46c6-b140-560554a8fddb tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:46.892237 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-799c5abf-8e94-46c6-b140-560554a8fddb tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:46.893431 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-799c5abf-8e94-46c6-b140-560554a8fddb tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:46.894065 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-799c5abf-8e94-46c6-b140-560554a8fddb tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:47.140983 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-799c5abf-8e94-46c6-b140-560554a8fddb tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:47.153817 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-799c5abf-8e94-46c6-b140-560554a8fddb tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:47.158208 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-799c5abf-8e94-46c6-b140-560554a8fddb tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:47.159504 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-799c5abf-8e94-46c6-b140-560554a8fddb tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1407 microversion: 2.20 time: 0.280603 Jul 05 13:01:47.164311 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-579e4382-c829-47e8-8419-3b8fcc3bfe08 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac264b6684ae4c3f9fc8903163693d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d337ebe3a0475b9331780325e17451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:47.175927 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 57/118] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:01:46 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1407 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:01:47.180334 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-579e4382-c829-47e8-8419-3b8fcc3bfe08 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] 10.222.0.36 "GET /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a" status: 200 len: 1315 microversion: 2.1 time: 0.324932 Jul 05 13:01:47.183052 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 62/119] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:46 2022] GET /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a => generated 1315 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:01:47.868709 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-ebef2c70-908f-4c42-865d-57f007acf37a tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:47.869330 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-ebef2c70-908f-4c42-865d-57f007acf37a tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 0f8f2957-1273-413b-ab2b-32da8868f70d] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:47.875567 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ebef2c70-908f-4c42-865d-57f007acf37a tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:47.876028 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ebef2c70-908f-4c42-865d-57f007acf37a tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:47.876827 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ebef2c70-908f-4c42-865d-57f007acf37a tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:47.877436 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ebef2c70-908f-4c42-865d-57f007acf37a tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:47.884452 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-71c49c81-1be1-4afd-9b8a-414962603bbc tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:47.885604 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-71c49c81-1be1-4afd-9b8a-414962603bbc tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:47.892324 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-71c49c81-1be1-4afd-9b8a-414962603bbc tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:47.893057 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-71c49c81-1be1-4afd-9b8a-414962603bbc tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:47.893830 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-71c49c81-1be1-4afd-9b8a-414962603bbc tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:47.894278 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-71c49c81-1be1-4afd-9b8a-414962603bbc tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:48.260082 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-ebef2c70-908f-4c42-865d-57f007acf37a tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:48.267465 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-ebef2c70-908f-4c42-865d-57f007acf37a tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d" status: 200 len: 1367 microversion: 2.1 time: 0.403219 Jul 05 13:01:48.268036 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 58/120] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:47 2022] GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d => generated 1367 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:01:48.272977 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-0e34da20-071f-4016-98cf-dba2593b454d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:48.273577 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-0e34da20-071f-4016-98cf-dba2593b454d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:48.279599 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0e34da20-071f-4016-98cf-dba2593b454d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:48.279759 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-71c49c81-1be1-4afd-9b8a-414962603bbc tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:48.280038 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0e34da20-071f-4016-98cf-dba2593b454d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:48.280818 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0e34da20-071f-4016-98cf-dba2593b454d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:48.281248 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0e34da20-071f-4016-98cf-dba2593b454d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:48.287300 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-71c49c81-1be1-4afd-9b8a-414962603bbc tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1322 microversion: 2.1 time: 0.408038 Jul 05 13:01:48.288441 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 63/121] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:47 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1322 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:01:48.292874 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-e431dbcb-e9fd-48ec-8c39-3b23b4a5c19f tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:48.293532 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-e431dbcb-e9fd-48ec-8c39-3b23b4a5c19f tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] [instance: 60d29496-d306-4d93-b1ca-23afb86dd55a] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:48.299228 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e431dbcb-e9fd-48ec-8c39-3b23b4a5c19f tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:48.299740 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e431dbcb-e9fd-48ec-8c39-3b23b4a5c19f tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:48.300562 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e431dbcb-e9fd-48ec-8c39-3b23b4a5c19f tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:48.301089 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e431dbcb-e9fd-48ec-8c39-3b23b4a5c19f tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:48.484844 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-0e34da20-071f-4016-98cf-dba2593b454d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:48.494202 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-0e34da20-071f-4016-98cf-dba2593b454d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:48.496627 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-0e34da20-071f-4016-98cf-dba2593b454d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:48.499200 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-0e34da20-071f-4016-98cf-dba2593b454d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1407 microversion: 2.20 time: 0.230153 Jul 05 13:01:48.507590 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-e431dbcb-e9fd-48ec-8c39-3b23b4a5c19f tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac264b6684ae4c3f9fc8903163693d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d337ebe3a0475b9331780325e17451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:48.512411 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 59/122] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:01:48 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1407 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:01:48.520183 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-e431dbcb-e9fd-48ec-8c39-3b23b4a5c19f tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] 10.222.0.36 "GET /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a" status: 200 len: 1315 microversion: 2.1 time: 0.230570 Jul 05 13:01:48.520863 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 64/123] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:48 2022] GET /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:01:49.284222 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-8b1c04d6-524b-4c39-89d5-b92ca48291dd tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:49.284866 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-8b1c04d6-524b-4c39-89d5-b92ca48291dd tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 0f8f2957-1273-413b-ab2b-32da8868f70d] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:49.290801 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8b1c04d6-524b-4c39-89d5-b92ca48291dd tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:49.291246 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8b1c04d6-524b-4c39-89d5-b92ca48291dd tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:49.298837 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8b1c04d6-524b-4c39-89d5-b92ca48291dd tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:49.298837 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8b1c04d6-524b-4c39-89d5-b92ca48291dd tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:49.309807 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-f3552f25-fdef-4d92-9130-26f0c5de2427 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:49.310421 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-f3552f25-fdef-4d92-9130-26f0c5de2427 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:49.316937 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f3552f25-fdef-4d92-9130-26f0c5de2427 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:49.317395 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f3552f25-fdef-4d92-9130-26f0c5de2427 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:49.318157 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f3552f25-fdef-4d92-9130-26f0c5de2427 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:49.318848 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f3552f25-fdef-4d92-9130-26f0c5de2427 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:49.520046 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-f3552f25-fdef-4d92-9130-26f0c5de2427 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:49.520552 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-8b1c04d6-524b-4c39-89d5-b92ca48291dd tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:49.529080 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-f3552f25-fdef-4d92-9130-26f0c5de2427 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1322 microversion: 2.1 time: 0.223020 Jul 05 13:01:49.529591 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-8b1c04d6-524b-4c39-89d5-b92ca48291dd tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d" status: 200 len: 1367 microversion: 2.1 time: 0.249682 Jul 05 13:01:49.530365 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 65/124] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:49 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1322 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:01:49.540457 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 60/125] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:49 2022] GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d => generated 1367 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:01:49.540457 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-4047cc1d-1f75-4fec-9fc4-79064dca3794 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:49.540457 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-4047cc1d-1f75-4fec-9fc4-79064dca3794 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] [instance: 60d29496-d306-4d93-b1ca-23afb86dd55a] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:49.545051 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-99afe882-ba5b-4a6e-9c47-b87c7ff5112d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:49.545671 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-99afe882-ba5b-4a6e-9c47-b87c7ff5112d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:49.546213 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4047cc1d-1f75-4fec-9fc4-79064dca3794 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:49.546669 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4047cc1d-1f75-4fec-9fc4-79064dca3794 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:49.547466 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4047cc1d-1f75-4fec-9fc4-79064dca3794 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:49.547903 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4047cc1d-1f75-4fec-9fc4-79064dca3794 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:49.551739 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-99afe882-ba5b-4a6e-9c47-b87c7ff5112d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:49.552359 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-99afe882-ba5b-4a6e-9c47-b87c7ff5112d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:49.553210 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-99afe882-ba5b-4a6e-9c47-b87c7ff5112d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:49.554170 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-99afe882-ba5b-4a6e-9c47-b87c7ff5112d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:49.739104 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-4047cc1d-1f75-4fec-9fc4-79064dca3794 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac264b6684ae4c3f9fc8903163693d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d337ebe3a0475b9331780325e17451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:49.746831 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-99afe882-ba5b-4a6e-9c47-b87c7ff5112d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:49.747465 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-4047cc1d-1f75-4fec-9fc4-79064dca3794 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] 10.222.0.36 "GET /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a" status: 200 len: 1315 microversion: 2.1 time: 0.214105 Jul 05 13:01:49.748071 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 61/126] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:49 2022] GET /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:01:49.755334 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-99afe882-ba5b-4a6e-9c47-b87c7ff5112d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:49.757643 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-99afe882-ba5b-4a6e-9c47-b87c7ff5112d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:49.758743 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-99afe882-ba5b-4a6e-9c47-b87c7ff5112d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1407 microversion: 2.20 time: 0.227275 Jul 05 13:01:49.759288 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 66/127] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:01:49 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1407 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:01:50.536084 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-1d998001-8875-4b32-9255-f701f558eed1 req-7e0085b7-bfc5-4b59-a388-0cc1dfd8543a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60d29496-d306-4d93-b1ca-23afb86dd55a", "name": "network-vif-plugged", "status": "completed", "tag": "41a618a8-294c-42b1-90ce-4aa0a088ade4"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:01:50.547834 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-1d998001-8875-4b32-9255-f701f558eed1 req-7e0085b7-bfc5-4b59-a388-0cc1dfd8543a service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:50.548294 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-1d998001-8875-4b32-9255-f701f558eed1 req-7e0085b7-bfc5-4b59-a388-0cc1dfd8543a service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:50.549939 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-b549f410-518b-4ea1-b4d7-6c62f7ac58b3 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:50.551476 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-b549f410-518b-4ea1-b4d7-6c62f7ac58b3 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:50.562108 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b549f410-518b-4ea1-b4d7-6c62f7ac58b3 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:50.562976 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b549f410-518b-4ea1-b4d7-6c62f7ac58b3 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:50.564016 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b549f410-518b-4ea1-b4d7-6c62f7ac58b3 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:50.564969 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b549f410-518b-4ea1-b4d7-6c62f7ac58b3 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:50.570161 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-1d998001-8875-4b32-9255-f701f558eed1 req-7e0085b7-bfc5-4b59-a388-0cc1dfd8543a service nova] Creating event network-vif-plugged:41a618a8-294c-42b1-90ce-4aa0a088ade4 for instance 60d29496-d306-4d93-b1ca-23afb86dd55a on hv-cinder-79760 Jul 05 13:01:50.576725 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-1d998001-8875-4b32-9255-f701f558eed1 req-7e0085b7-bfc5-4b59-a388-0cc1dfd8543a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046000 Jul 05 13:01:50.577319 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 62/128] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:01:50.586231 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-5cd68b5c-7fc9-4bf2-93cf-5eee5b9b75df tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:50.587060 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-5cd68b5c-7fc9-4bf2-93cf-5eee5b9b75df tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 0f8f2957-1273-413b-ab2b-32da8868f70d] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:50.594568 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5cd68b5c-7fc9-4bf2-93cf-5eee5b9b75df tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:50.595026 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5cd68b5c-7fc9-4bf2-93cf-5eee5b9b75df tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:50.595808 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5cd68b5c-7fc9-4bf2-93cf-5eee5b9b75df tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:50.596246 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5cd68b5c-7fc9-4bf2-93cf-5eee5b9b75df tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:50.832845 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-5cd68b5c-7fc9-4bf2-93cf-5eee5b9b75df tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:50.844616 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-5cd68b5c-7fc9-4bf2-93cf-5eee5b9b75df tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d" status: 200 len: 1367 microversion: 2.1 time: 0.263079 Jul 05 13:01:50.845668 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 63/129] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:50 2022] GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d => generated 1367 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:01:50.848863 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-b549f410-518b-4ea1-b4d7-6c62f7ac58b3 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:50.852892 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-c95eb3be-431f-47e9-b3d0-5525e2920171 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:50.853811 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-c95eb3be-431f-47e9-b3d0-5525e2920171 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] [instance: 60d29496-d306-4d93-b1ca-23afb86dd55a] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:50.858932 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-b549f410-518b-4ea1-b4d7-6c62f7ac58b3 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1322 microversion: 2.1 time: 0.315058 Jul 05 13:01:50.863837 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c95eb3be-431f-47e9-b3d0-5525e2920171 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:50.864464 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c95eb3be-431f-47e9-b3d0-5525e2920171 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:50.864700 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 67/130] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:50 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1322 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:01:50.865430 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c95eb3be-431f-47e9-b3d0-5525e2920171 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:50.866154 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c95eb3be-431f-47e9-b3d0-5525e2920171 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:50.871910 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-0195fe85-7296-4f42-854f-d973cbf9c103 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:50.872616 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-0195fe85-7296-4f42-854f-d973cbf9c103 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:50.879747 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-0195fe85-7296-4f42-854f-d973cbf9c103 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:50.880198 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-0195fe85-7296-4f42-854f-d973cbf9c103 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:50.880997 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-0195fe85-7296-4f42-854f-d973cbf9c103 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:50.885499 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-0195fe85-7296-4f42-854f-d973cbf9c103 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:51.112675 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-c95eb3be-431f-47e9-b3d0-5525e2920171 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac264b6684ae4c3f9fc8903163693d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d337ebe3a0475b9331780325e17451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:51.118668 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-0195fe85-7296-4f42-854f-d973cbf9c103 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:51.121447 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-c95eb3be-431f-47e9-b3d0-5525e2920171 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] 10.222.0.36 "GET /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a" status: 200 len: 1315 microversion: 2.1 time: 0.274401 Jul 05 13:01:51.122198 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 64/131] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:50 2022] GET /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:01:51.127455 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-0195fe85-7296-4f42-854f-d973cbf9c103 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:51.129259 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-0195fe85-7296-4f42-854f-d973cbf9c103 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:51.130442 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-0195fe85-7296-4f42-854f-d973cbf9c103 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1407 microversion: 2.20 time: 0.264047 Jul 05 13:01:51.131137 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 68/132] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:01:50 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1407 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:01:51.866853 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-5e518d52-8bf6-4767-a2ae-11c8052b1618 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:51.867476 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-5e518d52-8bf6-4767-a2ae-11c8052b1618 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 0f8f2957-1273-413b-ab2b-32da8868f70d] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:51.873929 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5e518d52-8bf6-4767-a2ae-11c8052b1618 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:51.876611 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5e518d52-8bf6-4767-a2ae-11c8052b1618 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:51.876611 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5e518d52-8bf6-4767-a2ae-11c8052b1618 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:51.876611 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5e518d52-8bf6-4767-a2ae-11c8052b1618 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:51.878414 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-2b2a5759-af3d-40b0-8565-a3719c8df965 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:51.880020 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-2b2a5759-af3d-40b0-8565-a3719c8df965 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:51.890529 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-2b2a5759-af3d-40b0-8565-a3719c8df965 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:51.891018 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-2b2a5759-af3d-40b0-8565-a3719c8df965 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:51.892054 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-2b2a5759-af3d-40b0-8565-a3719c8df965 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:51.892672 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-2b2a5759-af3d-40b0-8565-a3719c8df965 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:52.088511 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-5e518d52-8bf6-4767-a2ae-11c8052b1618 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:52.096384 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-5e518d52-8bf6-4767-a2ae-11c8052b1618 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d" status: 200 len: 1367 microversion: 2.1 time: 0.235443 Jul 05 13:01:52.096937 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 65/133] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:51 2022] GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d => generated 1367 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:01:52.120442 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-2b2a5759-af3d-40b0-8565-a3719c8df965 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:52.130586 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-2b2a5759-af3d-40b0-8565-a3719c8df965 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1322 microversion: 2.1 time: 0.257613 Jul 05 13:01:52.136892 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 69/134] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:51 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1322 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:01:52.144963 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-0ed97a68-57cd-4771-af3d-4f00de967bc1 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:52.145703 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-0ed97a68-57cd-4771-af3d-4f00de967bc1 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] [instance: 60d29496-d306-4d93-b1ca-23afb86dd55a] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:52.154345 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0ed97a68-57cd-4771-af3d-4f00de967bc1 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:52.155432 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-441d46a0-34a7-44dd-ad15-06873e8a0f2f tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:52.156243 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-441d46a0-34a7-44dd-ad15-06873e8a0f2f tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:52.157166 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0ed97a68-57cd-4771-af3d-4f00de967bc1 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:52.160099 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0ed97a68-57cd-4771-af3d-4f00de967bc1 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:52.160551 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0ed97a68-57cd-4771-af3d-4f00de967bc1 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:52.163668 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-441d46a0-34a7-44dd-ad15-06873e8a0f2f tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:52.164197 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-441d46a0-34a7-44dd-ad15-06873e8a0f2f tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:52.165207 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-441d46a0-34a7-44dd-ad15-06873e8a0f2f tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:52.165866 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-441d46a0-34a7-44dd-ad15-06873e8a0f2f tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:52.407686 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-0ed97a68-57cd-4771-af3d-4f00de967bc1 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac264b6684ae4c3f9fc8903163693d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d337ebe3a0475b9331780325e17451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:52.416893 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-0ed97a68-57cd-4771-af3d-4f00de967bc1 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] 10.222.0.36 "GET /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a" status: 200 len: 1315 microversion: 2.1 time: 0.280924 Jul 05 13:01:52.421359 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 66/135] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:52 2022] GET /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a => generated 1315 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:01:52.458251 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-441d46a0-34a7-44dd-ad15-06873e8a0f2f tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:52.460075 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-441d46a0-34a7-44dd-ad15-06873e8a0f2f tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:52.462306 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-441d46a0-34a7-44dd-ad15-06873e8a0f2f tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:52.463718 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-441d46a0-34a7-44dd-ad15-06873e8a0f2f tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1407 microversion: 2.20 time: 0.312844 Jul 05 13:01:52.464360 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 70/136] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:01:52 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1407 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 13:01:52.607602 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-dc54e77a-d5de-4a31-b059-15231dbf520b req-bbec2792-a807-4487-9942-84bfd1ebd7cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72285b0b-7735-422b-b110-ef7b03fb367f", "name": "network-vif-plugged", "status": "completed", "tag": "caf3b4b2-126a-423d-b8ca-4680670bb511"}, {"server_uuid": "f896e7e9-27f6-4b6a-899c-ad0e27c88174", "name": "network-vif-plugged", "status": "completed", "tag": "ce02c625-8d30-42c8-adf6-df23075f0cb7"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:01:52.619562 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-dc54e77a-d5de-4a31-b059-15231dbf520b req-bbec2792-a807-4487-9942-84bfd1ebd7cf service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:52.620367 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-dc54e77a-d5de-4a31-b059-15231dbf520b req-bbec2792-a807-4487-9942-84bfd1ebd7cf service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:52.638126 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-dc54e77a-d5de-4a31-b059-15231dbf520b req-bbec2792-a807-4487-9942-84bfd1ebd7cf service nova] Creating event network-vif-plugged:caf3b4b2-126a-423d-b8ca-4680670bb511 for instance 72285b0b-7735-422b-b110-ef7b03fb367f on hv-cinder-79760 Jul 05 13:01:52.638918 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-dc54e77a-d5de-4a31-b059-15231dbf520b req-bbec2792-a807-4487-9942-84bfd1ebd7cf service nova] Creating event network-vif-plugged:ce02c625-8d30-42c8-adf6-df23075f0cb7 for instance f896e7e9-27f6-4b6a-899c-ad0e27c88174 on hv-cinder-79760 Jul 05 13:01:52.646219 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-dc54e77a-d5de-4a31-b059-15231dbf520b req-bbec2792-a807-4487-9942-84bfd1ebd7cf service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.042874 Jul 05 13:01:52.646844 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 67/137] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:01:53.114864 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-cb00b5d4-2c2b-4599-b3b6-7a7e8a4e30c5 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:53.115455 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-cb00b5d4-2c2b-4599-b3b6-7a7e8a4e30c5 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 0f8f2957-1273-413b-ab2b-32da8868f70d] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:53.121744 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-cb00b5d4-2c2b-4599-b3b6-7a7e8a4e30c5 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:53.122182 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-cb00b5d4-2c2b-4599-b3b6-7a7e8a4e30c5 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:53.123149 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-cb00b5d4-2c2b-4599-b3b6-7a7e8a4e30c5 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:53.123560 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-cb00b5d4-2c2b-4599-b3b6-7a7e8a4e30c5 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:53.159065 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-d5c1ef82-fa96-4795-ab5e-7f4f23ebfab5 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:53.161164 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-d5c1ef82-fa96-4795-ab5e-7f4f23ebfab5 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:53.187294 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d5c1ef82-fa96-4795-ab5e-7f4f23ebfab5 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:53.187677 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d5c1ef82-fa96-4795-ab5e-7f4f23ebfab5 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:53.188628 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d5c1ef82-fa96-4795-ab5e-7f4f23ebfab5 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:53.189088 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d5c1ef82-fa96-4795-ab5e-7f4f23ebfab5 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:53.399925 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-cb00b5d4-2c2b-4599-b3b6-7a7e8a4e30c5 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:53.407368 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-cb00b5d4-2c2b-4599-b3b6-7a7e8a4e30c5 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d" status: 200 len: 1367 microversion: 2.1 time: 0.296672 Jul 05 13:01:53.407950 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 71/138] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:53 2022] GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d => generated 1367 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:01:53.433757 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-03ad8d7f-8fd3-49bd-8fbb-5ed9125a86b2 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:53.434297 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-03ad8d7f-8fd3-49bd-8fbb-5ed9125a86b2 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] [instance: 60d29496-d306-4d93-b1ca-23afb86dd55a] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:53.437203 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-d5c1ef82-fa96-4795-ab5e-7f4f23ebfab5 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:53.441305 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-03ad8d7f-8fd3-49bd-8fbb-5ed9125a86b2 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:53.441948 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-03ad8d7f-8fd3-49bd-8fbb-5ed9125a86b2 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:53.442876 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-03ad8d7f-8fd3-49bd-8fbb-5ed9125a86b2 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:53.443474 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-03ad8d7f-8fd3-49bd-8fbb-5ed9125a86b2 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:53.446282 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-d5c1ef82-fa96-4795-ab5e-7f4f23ebfab5 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1322 microversion: 2.1 time: 0.294931 Jul 05 13:01:53.447395 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 68/139] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:53 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1322 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:01:53.482572 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-89b2b0f9-c546-4f38-8e8f-202a10941062 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:53.483188 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-89b2b0f9-c546-4f38-8e8f-202a10941062 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:53.489364 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-89b2b0f9-c546-4f38-8e8f-202a10941062 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:53.489816 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-89b2b0f9-c546-4f38-8e8f-202a10941062 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:53.490586 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-89b2b0f9-c546-4f38-8e8f-202a10941062 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:53.491069 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-89b2b0f9-c546-4f38-8e8f-202a10941062 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:53.690550 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-89b2b0f9-c546-4f38-8e8f-202a10941062 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:53.691683 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell1:SELECT=100 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:53.695159 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-89b2b0f9-c546-4f38-8e8f-202a10941062 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:53.696715 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-89b2b0f9-c546-4f38-8e8f-202a10941062 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:53.698027 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-89b2b0f9-c546-4f38-8e8f-202a10941062 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1407 microversion: 2.20 time: 0.219385 Jul 05 13:01:53.698590 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 69/140] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:01:53 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1407 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 13:01:53.715139 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-03ad8d7f-8fd3-49bd-8fbb-5ed9125a86b2 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac264b6684ae4c3f9fc8903163693d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d337ebe3a0475b9331780325e17451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:53.722637 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-03ad8d7f-8fd3-49bd-8fbb-5ed9125a86b2 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] 10.222.0.36 "GET /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a" status: 200 len: 1315 microversion: 2.1 time: 0.292702 Jul 05 13:01:53.723204 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 72/141] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:53 2022] GET /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a => generated 1315 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:01:54.423594 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-d8e3ab5c-a64b-43b4-9b19-51cf9bd26adb tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:54.424229 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-d8e3ab5c-a64b-43b4-9b19-51cf9bd26adb tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 0f8f2957-1273-413b-ab2b-32da8868f70d] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:54.430267 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d8e3ab5c-a64b-43b4-9b19-51cf9bd26adb tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:54.430713 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d8e3ab5c-a64b-43b4-9b19-51cf9bd26adb tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:54.431470 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d8e3ab5c-a64b-43b4-9b19-51cf9bd26adb tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:54.431934 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d8e3ab5c-a64b-43b4-9b19-51cf9bd26adb tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:54.464241 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-b7637959-a550-4b88-a6e9-75b97e1a57d0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:54.465527 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-b7637959-a550-4b88-a6e9-75b97e1a57d0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:54.472410 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b7637959-a550-4b88-a6e9-75b97e1a57d0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:54.473216 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b7637959-a550-4b88-a6e9-75b97e1a57d0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:54.474075 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b7637959-a550-4b88-a6e9-75b97e1a57d0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:54.474615 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b7637959-a550-4b88-a6e9-75b97e1a57d0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:54.625953 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-d8e3ab5c-a64b-43b4-9b19-51cf9bd26adb tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:54.639724 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-d8e3ab5c-a64b-43b4-9b19-51cf9bd26adb tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d" status: 200 len: 1367 microversion: 2.1 time: 0.219902 Jul 05 13:01:54.640416 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 70/142] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:54 2022] GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d => generated 1367 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:01:54.651101 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-b7637959-a550-4b88-a6e9-75b97e1a57d0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:54.658593 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-b7637959-a550-4b88-a6e9-75b97e1a57d0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1322 microversion: 2.1 time: 0.198690 Jul 05 13:01:54.659466 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 73/143] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:54 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1322 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:01:54.665049 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-99758273-a074-4e66-b422-e1cf80c45c86 req-d26a7a12-3ba9-48d6-8147-983ecf211daf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f8f2957-1273-413b-ab2b-32da8868f70d", "name": "network-vif-plugged", "status": "completed", "tag": "ce361f6b-ae21-4c14-aee3-5bdf13b4b44f"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:01:54.673278 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-99758273-a074-4e66-b422-e1cf80c45c86 req-d26a7a12-3ba9-48d6-8147-983ecf211daf service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:54.673819 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-99758273-a074-4e66-b422-e1cf80c45c86 req-d26a7a12-3ba9-48d6-8147-983ecf211daf service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:54.685376 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-99758273-a074-4e66-b422-e1cf80c45c86 req-d26a7a12-3ba9-48d6-8147-983ecf211daf service nova] Creating event network-vif-plugged:ce361f6b-ae21-4c14-aee3-5bdf13b4b44f for instance 0f8f2957-1273-413b-ab2b-32da8868f70d on hv-cinder-79760 Jul 05 13:01:54.690692 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-99758273-a074-4e66-b422-e1cf80c45c86 req-d26a7a12-3ba9-48d6-8147-983ecf211daf service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030368 Jul 05 13:01:54.691283 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 71/144] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:01:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:01:54.716208 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-07714596-acbd-45aa-9664-f53973b5f6cb tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:54.716867 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-07714596-acbd-45aa-9664-f53973b5f6cb tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:54.723022 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-07714596-acbd-45aa-9664-f53973b5f6cb tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:54.723466 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-07714596-acbd-45aa-9664-f53973b5f6cb tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:54.724235 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-07714596-acbd-45aa-9664-f53973b5f6cb tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:54.724776 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-07714596-acbd-45aa-9664-f53973b5f6cb tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:54.743751 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-d7d89e6e-be74-47b4-a1f5-80256789c0d7 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:54.744887 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-d7d89e6e-be74-47b4-a1f5-80256789c0d7 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] [instance: 60d29496-d306-4d93-b1ca-23afb86dd55a] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:54.751545 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d7d89e6e-be74-47b4-a1f5-80256789c0d7 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:54.752139 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d7d89e6e-be74-47b4-a1f5-80256789c0d7 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:54.753059 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d7d89e6e-be74-47b4-a1f5-80256789c0d7 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:54.753585 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d7d89e6e-be74-47b4-a1f5-80256789c0d7 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:54.948173 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-07714596-acbd-45aa-9664-f53973b5f6cb tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:54.952332 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-d7d89e6e-be74-47b4-a1f5-80256789c0d7 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac264b6684ae4c3f9fc8903163693d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d337ebe3a0475b9331780325e17451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:54.956953 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-07714596-acbd-45aa-9664-f53973b5f6cb tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:54.959998 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-07714596-acbd-45aa-9664-f53973b5f6cb tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:54.960447 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-d7d89e6e-be74-47b4-a1f5-80256789c0d7 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] 10.222.0.36 "GET /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a" status: 200 len: 1315 microversion: 2.1 time: 0.221359 Jul 05 13:01:54.961214 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 72/145] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:54 2022] GET /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:01:54.970062 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-07714596-acbd-45aa-9664-f53973b5f6cb tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1407 microversion: 2.20 time: 0.258248 Jul 05 13:01:54.970544 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 74/146] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:01:54 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1407 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:01:55.657246 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-0148a2cb-6321-4ed9-acc4-62014f58c72a tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:55.657856 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-0148a2cb-6321-4ed9-acc4-62014f58c72a tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 0f8f2957-1273-413b-ab2b-32da8868f70d] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:55.664188 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0148a2cb-6321-4ed9-acc4-62014f58c72a tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:55.664692 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0148a2cb-6321-4ed9-acc4-62014f58c72a tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:55.665479 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0148a2cb-6321-4ed9-acc4-62014f58c72a tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:55.665916 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0148a2cb-6321-4ed9-acc4-62014f58c72a tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:55.676244 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-b749a27d-740f-4568-ba66-b1eec7443a33 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:55.676942 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-b749a27d-740f-4568-ba66-b1eec7443a33 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:55.684738 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b749a27d-740f-4568-ba66-b1eec7443a33 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:55.685187 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b749a27d-740f-4568-ba66-b1eec7443a33 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:55.686161 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b749a27d-740f-4568-ba66-b1eec7443a33 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:55.686597 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b749a27d-740f-4568-ba66-b1eec7443a33 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:55.869742 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-0148a2cb-6321-4ed9-acc4-62014f58c72a tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:55.881838 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-0148a2cb-6321-4ed9-acc4-62014f58c72a tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d" status: 200 len: 1367 microversion: 2.1 time: 0.227837 Jul 05 13:01:55.882542 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 73/147] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:55 2022] GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d => generated 1367 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:01:55.884529 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-b749a27d-740f-4568-ba66-b1eec7443a33 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:55.895010 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-b749a27d-740f-4568-ba66-b1eec7443a33 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1322 microversion: 2.1 time: 0.223181 Jul 05 13:01:55.896005 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 75/148] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:55 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1322 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:01:55.977986 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-be26ac22-d275-445d-aeb5-81c5b81bcc93 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:55.978563 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-be26ac22-d275-445d-aeb5-81c5b81bcc93 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] [instance: 60d29496-d306-4d93-b1ca-23afb86dd55a] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:56.003943 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-ea597ae0-f999-441c-9704-c4bab4b40639 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:56.004699 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-ea597ae0-f999-441c-9704-c4bab4b40639 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:56.014150 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-be26ac22-d275-445d-aeb5-81c5b81bcc93 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:56.014379 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ea597ae0-f999-441c-9704-c4bab4b40639 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:56.014605 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-be26ac22-d275-445d-aeb5-81c5b81bcc93 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:56.019647 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ea597ae0-f999-441c-9704-c4bab4b40639 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:56.019805 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-be26ac22-d275-445d-aeb5-81c5b81bcc93 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:56.020245 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-be26ac22-d275-445d-aeb5-81c5b81bcc93 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:56.020925 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ea597ae0-f999-441c-9704-c4bab4b40639 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:56.021588 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ea597ae0-f999-441c-9704-c4bab4b40639 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:56.026681 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_cell1:SELECT=100 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:56.327689 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-ea597ae0-f999-441c-9704-c4bab4b40639 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:56.340307 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-ea597ae0-f999-441c-9704-c4bab4b40639 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:56.344511 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-ea597ae0-f999-441c-9704-c4bab4b40639 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:56.347280 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-ea597ae0-f999-441c-9704-c4bab4b40639 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1407 microversion: 2.20 time: 0.358420 Jul 05 13:01:56.348605 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 76/149] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:01:55 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1407 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:01:56.369895 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-be26ac22-d275-445d-aeb5-81c5b81bcc93 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac264b6684ae4c3f9fc8903163693d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d337ebe3a0475b9331780325e17451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:56.377367 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-be26ac22-d275-445d-aeb5-81c5b81bcc93 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] 10.222.0.36 "GET /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a" status: 200 len: 1500 microversion: 2.1 time: 0.403683 Jul 05 13:01:56.377926 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 74/150] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:55 2022] GET /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a => generated 1500 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:01:56.901083 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-d2eb4c52-965a-4750-834e-3f14ad7409b0 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:56.901770 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-d2eb4c52-965a-4750-834e-3f14ad7409b0 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 0f8f2957-1273-413b-ab2b-32da8868f70d] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:56.913803 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-d2eb4c52-965a-4750-834e-3f14ad7409b0 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:56.913803 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-d2eb4c52-965a-4750-834e-3f14ad7409b0 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:56.913803 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-d2eb4c52-965a-4750-834e-3f14ad7409b0 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:56.913803 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-d2eb4c52-965a-4750-834e-3f14ad7409b0 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:56.915514 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-dcc2fc27-b7f7-421c-aacd-faec3c4e4395 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:56.916966 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-dcc2fc27-b7f7-421c-aacd-faec3c4e4395 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:56.925180 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-dcc2fc27-b7f7-421c-aacd-faec3c4e4395 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:56.925632 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-dcc2fc27-b7f7-421c-aacd-faec3c4e4395 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:56.926601 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-dcc2fc27-b7f7-421c-aacd-faec3c4e4395 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:56.927037 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-dcc2fc27-b7f7-421c-aacd-faec3c4e4395 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:57.133524 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-d2eb4c52-965a-4750-834e-3f14ad7409b0 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:57.146073 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-d2eb4c52-965a-4750-834e-3f14ad7409b0 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d" status: 200 len: 1367 microversion: 2.1 time: 0.250276 Jul 05 13:01:57.146412 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 77/151] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:56 2022] GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d => generated 1367 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:01:57.157551 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-dcc2fc27-b7f7-421c-aacd-faec3c4e4395 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:57.166228 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-dcc2fc27-b7f7-421c-aacd-faec3c4e4395 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1322 microversion: 2.1 time: 0.256720 Jul 05 13:01:57.167116 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 75/152] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:56 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1322 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:01:57.366727 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-63b331eb-0c06-4841-9280-084f34beac94 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:57.367622 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-63b331eb-0c06-4841-9280-084f34beac94 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:57.375399 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-63b331eb-0c06-4841-9280-084f34beac94 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:57.375850 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-63b331eb-0c06-4841-9280-084f34beac94 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:57.376623 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-63b331eb-0c06-4841-9280-084f34beac94 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:57.377061 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-63b331eb-0c06-4841-9280-084f34beac94 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:57.540449 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-63b331eb-0c06-4841-9280-084f34beac94 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:57.567843 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-63b331eb-0c06-4841-9280-084f34beac94 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:57.567843 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-63b331eb-0c06-4841-9280-084f34beac94 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:57.567843 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-63b331eb-0c06-4841-9280-084f34beac94 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1407 microversion: 2.20 time: 0.193388 Jul 05 13:01:57.568506 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 78/153] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:01:57 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1407 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:01:58.167002 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-344d24c0-8e20-4c83-8157-9462de233c5c tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:58.167628 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-344d24c0-8e20-4c83-8157-9462de233c5c tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 0f8f2957-1273-413b-ab2b-32da8868f70d] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:58.173711 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-344d24c0-8e20-4c83-8157-9462de233c5c tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:58.174163 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-344d24c0-8e20-4c83-8157-9462de233c5c tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:58.174988 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-344d24c0-8e20-4c83-8157-9462de233c5c tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:58.175423 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-344d24c0-8e20-4c83-8157-9462de233c5c tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:58.185080 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-64237c93-6418-4e58-88a7-392c7a7b8314 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:58.185793 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-64237c93-6418-4e58-88a7-392c7a7b8314 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:58.193128 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-64237c93-6418-4e58-88a7-392c7a7b8314 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:58.193910 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-64237c93-6418-4e58-88a7-392c7a7b8314 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:58.195248 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-64237c93-6418-4e58-88a7-392c7a7b8314 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:58.195992 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-64237c93-6418-4e58-88a7-392c7a7b8314 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:58.401589 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-344d24c0-8e20-4c83-8157-9462de233c5c tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:58.412917 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-64237c93-6418-4e58-88a7-392c7a7b8314 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:58.417569 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-344d24c0-8e20-4c83-8157-9462de233c5c tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d" status: 200 len: 1367 microversion: 2.1 time: 0.254925 Jul 05 13:01:58.418265 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-64237c93-6418-4e58-88a7-392c7a7b8314 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1322 microversion: 2.1 time: 0.237981 Jul 05 13:01:58.418834 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 79/154] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:58 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1322 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:01:58.419815 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 76/155] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:58 2022] GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d => generated 1367 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:01:58.581284 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-1bd3b792-d502-4adc-9276-6066b5965bbd tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:58.581893 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-1bd3b792-d502-4adc-9276-6066b5965bbd tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:58.588079 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-1bd3b792-d502-4adc-9276-6066b5965bbd tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:58.588534 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-1bd3b792-d502-4adc-9276-6066b5965bbd tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:58.589317 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-1bd3b792-d502-4adc-9276-6066b5965bbd tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:58.589764 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-1bd3b792-d502-4adc-9276-6066b5965bbd tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:58.653688 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-4e678441-588f-4174-9f0c-db37c9327e97 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "72f4a576-f0ef-47b7-ad20-234dc101dfa4"}} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:01:58.654833 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-4e678441-588f-4174-9f0c-db37c9327e97 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] [instance: 60d29496-d306-4d93-b1ca-23afb86dd55a] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:58.660910 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4e678441-588f-4174-9f0c-db37c9327e97 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:58.661356 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4e678441-588f-4174-9f0c-db37c9327e97 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:58.662148 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4e678441-588f-4174-9f0c-db37c9327e97 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:58.662655 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4e678441-588f-4174-9f0c-db37c9327e97 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:58.735748 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-1bd3b792-d502-4adc-9276-6066b5965bbd tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:58.744453 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-1bd3b792-d502-4adc-9276-6066b5965bbd tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:58.745973 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-1bd3b792-d502-4adc-9276-6066b5965bbd tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:58.747153 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-1bd3b792-d502-4adc-9276-6066b5965bbd tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1600 microversion: 2.20 time: 0.169773 Jul 05 13:01:58.759849 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 80/156] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:01:58 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1600 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 13:01:58.765714 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-502de3f7-ea2c-44ce-9d52-a6fd9319848d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:58.766330 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-502de3f7-ea2c-44ce-9d52-a6fd9319848d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:58.772675 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-502de3f7-ea2c-44ce-9d52-a6fd9319848d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:58.773126 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-502de3f7-ea2c-44ce-9d52-a6fd9319848d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:58.773959 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-502de3f7-ea2c-44ce-9d52-a6fd9319848d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:58.774596 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-502de3f7-ea2c-44ce-9d52-a6fd9319848d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:58.917081 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-502de3f7-ea2c-44ce-9d52-a6fd9319848d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.155113 Jul 05 13:01:58.917678 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 81/157] 10.222.0.36 () {60 vars in 1315 bytes} [Tue Jul 5 13:01:58 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f/os-interface => generated 285 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 13:01:59.438193 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-f14d5c74-08be-4e54-96e7-32c99803b61d tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:59.439657 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-f14d5c74-08be-4e54-96e7-32c99803b61d tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 0f8f2957-1273-413b-ab2b-32da8868f70d] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:59.442029 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_api:SELECT=99 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:59.447753 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f14d5c74-08be-4e54-96e7-32c99803b61d tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:59.448198 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f14d5c74-08be-4e54-96e7-32c99803b61d tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:59.449010 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f14d5c74-08be-4e54-96e7-32c99803b61d tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:59.449667 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f14d5c74-08be-4e54-96e7-32c99803b61d tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:59.590290 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-f14d5c74-08be-4e54-96e7-32c99803b61d tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:59.599600 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-f14d5c74-08be-4e54-96e7-32c99803b61d tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d" status: 200 len: 1367 microversion: 2.1 time: 0.167667 Jul 05 13:01:59.601117 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 82/158] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:59 2022] GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:01:59.621467 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-0ae1b60c-e126-406a-a733-1e13a817f958 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:01:59.622183 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-0ae1b60c-e126-406a-a733-1e13a817f958 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:01:59.630059 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-0ae1b60c-e126-406a-a733-1e13a817f958 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:59.630603 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-0ae1b60c-e126-406a-a733-1e13a817f958 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:59.632470 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-0ae1b60c-e126-406a-a733-1e13a817f958 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:01:59.632940 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-0ae1b60c-e126-406a-a733-1e13a817f958 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:01:59.782542 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-0ae1b60c-e126-406a-a733-1e13a817f958 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:01:59.791463 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-0ae1b60c-e126-406a-a733-1e13a817f958 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1322 microversion: 2.1 time: 0.187877 Jul 05 13:01:59.792410 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 83/159] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:01:59 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:02:00.598685 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [req-d46f3b5a-22dc-4ee2-ba4a-efca93f7b42f req-9a96f538-943e-45b2-855c-5e907b551817 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72285b0b-7735-422b-b110-ef7b03fb367f", "tag": "caf3b4b2-126a-423d-b8ca-4680670bb511"}]} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:02:00.608504 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-d46f3b5a-22dc-4ee2-ba4a-efca93f7b42f req-9a96f538-943e-45b2-855c-5e907b551817 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:00.609055 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-d46f3b5a-22dc-4ee2-ba4a-efca93f7b42f req-9a96f538-943e-45b2-855c-5e907b551817 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:00.620247 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.compute.server_external_events [req-d46f3b5a-22dc-4ee2-ba4a-efca93f7b42f req-9a96f538-943e-45b2-855c-5e907b551817 service nova] Creating event network-changed:caf3b4b2-126a-423d-b8ca-4680670bb511 for instance 72285b0b-7735-422b-b110-ef7b03fb367f on hv-cinder-79760 Jul 05 13:02:00.625657 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [req-d46f3b5a-22dc-4ee2-ba4a-efca93f7b42f req-9a96f538-943e-45b2-855c-5e907b551817 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030677 Jul 05 13:02:00.626247 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 84/160] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 13:02:00.631368 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-53829923-664b-4468-9cac-fcb5d01ed393 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:02:00.632068 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-53829923-664b-4468-9cac-fcb5d01ed393 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 0f8f2957-1273-413b-ab2b-32da8868f70d] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:02:00.638602 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-53829923-664b-4468-9cac-fcb5d01ed393 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:00.639042 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-53829923-664b-4468-9cac-fcb5d01ed393 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:00.639803 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-53829923-664b-4468-9cac-fcb5d01ed393 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:00.640235 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-53829923-664b-4468-9cac-fcb5d01ed393 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:00.779311 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-53829923-664b-4468-9cac-fcb5d01ed393 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:02:00.788550 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-53829923-664b-4468-9cac-fcb5d01ed393 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d" status: 200 len: 1367 microversion: 2.1 time: 0.161026 Jul 05 13:02:00.789395 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 85/161] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:02:00 2022] GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:02:00.810098 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-5a32fc23-d033-4bcf-b712-fe127aae3ba8 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:02:00.810920 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-5a32fc23-d033-4bcf-b712-fe127aae3ba8 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:02:00.817891 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-5a32fc23-d033-4bcf-b712-fe127aae3ba8 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:00.819688 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-5a32fc23-d033-4bcf-b712-fe127aae3ba8 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:00.820621 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-5a32fc23-d033-4bcf-b712-fe127aae3ba8 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:00.825080 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-5a32fc23-d033-4bcf-b712-fe127aae3ba8 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:00.967098 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-5a32fc23-d033-4bcf-b712-fe127aae3ba8 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:02:00.974990 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-5a32fc23-d033-4bcf-b712-fe127aae3ba8 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1322 microversion: 2.1 time: 0.168292 Jul 05 13:02:00.975562 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 86/162] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:02:00 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:02:01.806580 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-56ee7be4-b551-41ff-9fa9-82efd7319baa tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:02:01.807346 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-56ee7be4-b551-41ff-9fa9-82efd7319baa tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 0f8f2957-1273-413b-ab2b-32da8868f70d] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:02:01.818191 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-56ee7be4-b551-41ff-9fa9-82efd7319baa tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:01.818191 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-56ee7be4-b551-41ff-9fa9-82efd7319baa tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:01.818191 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-56ee7be4-b551-41ff-9fa9-82efd7319baa tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:01.818191 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-56ee7be4-b551-41ff-9fa9-82efd7319baa tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:01.980035 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-56ee7be4-b551-41ff-9fa9-82efd7319baa tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:02:01.990281 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-56ee7be4-b551-41ff-9fa9-82efd7319baa tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d" status: 200 len: 1367 microversion: 2.1 time: 0.188209 Jul 05 13:02:01.991026 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 87/163] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:02:01 2022] GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d => generated 1367 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:02:01.997356 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-be26d811-b19c-4f12-af81-683c99b8b7bf tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:02:01.997823 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-be26d811-b19c-4f12-af81-683c99b8b7bf tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:02:02.014373 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-be26d811-b19c-4f12-af81-683c99b8b7bf tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:02.014373 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-be26d811-b19c-4f12-af81-683c99b8b7bf tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:02.014373 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-be26d811-b19c-4f12-af81-683c99b8b7bf tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:02.014373 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-be26d811-b19c-4f12-af81-683c99b8b7bf tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:02.159484 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-be26d811-b19c-4f12-af81-683c99b8b7bf tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:02:02.176769 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-be26d811-b19c-4f12-af81-683c99b8b7bf tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1516 microversion: 2.1 time: 0.184875 Jul 05 13:02:02.177350 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 88/164] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:02:01 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1516 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:02:02.195941 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-63bc72e7-bad3-43a5-a893-5a3cd2a487bf tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:02:02.196950 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-63bc72e7-bad3-43a5-a893-5a3cd2a487bf tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:02:02.206514 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-63bc72e7-bad3-43a5-a893-5a3cd2a487bf tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:02.206979 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-63bc72e7-bad3-43a5-a893-5a3cd2a487bf tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:02.211837 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-63bc72e7-bad3-43a5-a893-5a3cd2a487bf tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:02.211837 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-63bc72e7-bad3-43a5-a893-5a3cd2a487bf tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:02.242750 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.objects.instance [None req-63bc72e7-bad3-43a5-a893-5a3cd2a487bf tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lazy-loading 'flavor' on Instance uuid f896e7e9-27f6-4b6a-899c-ad0e27c88174 {{(pid=118386) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 13:02:02.633868 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-63bc72e7-bad3-43a5-a893-5a3cd2a487bf tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "POST /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174/action" status: 200 len: 32 microversion: 2.1 time: 0.442484 Jul 05 13:02:02.634465 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 89/165] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Jul 5 13:02:02 2022] POST /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174/action => generated 32 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 05 13:02:02.643641 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-5f9dbc90-7702-4164-9b26-ef63f60112f0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:02:02.644388 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-5f9dbc90-7702-4164-9b26-ef63f60112f0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:02:02.651949 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-5f9dbc90-7702-4164-9b26-ef63f60112f0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:02.652403 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-5f9dbc90-7702-4164-9b26-ef63f60112f0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:02.653428 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-5f9dbc90-7702-4164-9b26-ef63f60112f0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:02.653633 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-5f9dbc90-7702-4164-9b26-ef63f60112f0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:02.981575 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-5f9dbc90-7702-4164-9b26-ef63f60112f0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:02:02.989019 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-5f9dbc90-7702-4164-9b26-ef63f60112f0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1522 microversion: 2.1 time: 0.349344 Jul 05 13:02:02.989584 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 90/166] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:02:02 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1522 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:02:03.005992 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-0a1e8994-eb0d-4052-9405-0d4b09df377d tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:02:03.009946 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-0a1e8994-eb0d-4052-9405-0d4b09df377d tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 0f8f2957-1273-413b-ab2b-32da8868f70d] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:02:03.012530 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-0a1e8994-eb0d-4052-9405-0d4b09df377d tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:03.013009 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-0a1e8994-eb0d-4052-9405-0d4b09df377d tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:03.013769 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-0a1e8994-eb0d-4052-9405-0d4b09df377d tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:03.014204 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-0a1e8994-eb0d-4052-9405-0d4b09df377d tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:03.142237 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-0a1e8994-eb0d-4052-9405-0d4b09df377d tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:02:03.145750 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:03.150572 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-0a1e8994-eb0d-4052-9405-0d4b09df377d tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d" status: 200 len: 1367 microversion: 2.1 time: 0.148351 Jul 05 13:02:03.151135 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 91/167] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:02:03 2022] GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:02:04.006519 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-adcf229d-cee6-4312-925d-0542ebd1725b tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:02:04.007122 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-adcf229d-cee6-4312-925d-0542ebd1725b tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:02:04.013844 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-adcf229d-cee6-4312-925d-0542ebd1725b tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:04.014289 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-adcf229d-cee6-4312-925d-0542ebd1725b tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:04.015034 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-adcf229d-cee6-4312-925d-0542ebd1725b tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:04.015463 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-adcf229d-cee6-4312-925d-0542ebd1725b tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:04.144976 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-adcf229d-cee6-4312-925d-0542ebd1725b tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:02:04.152928 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-adcf229d-cee6-4312-925d-0542ebd1725b tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1522 microversion: 2.1 time: 0.150455 Jul 05 13:02:04.153501 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 92/168] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:02:04 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:02:04.171382 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-bbceeb2c-6c74-4376-bf7c-cb8dd9b992b0 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:02:04.171992 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-bbceeb2c-6c74-4376-bf7c-cb8dd9b992b0 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 0f8f2957-1273-413b-ab2b-32da8868f70d] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:02:04.178862 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-bbceeb2c-6c74-4376-bf7c-cb8dd9b992b0 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:04.179685 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-bbceeb2c-6c74-4376-bf7c-cb8dd9b992b0 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:04.180743 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-bbceeb2c-6c74-4376-bf7c-cb8dd9b992b0 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:04.181264 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-bbceeb2c-6c74-4376-bf7c-cb8dd9b992b0 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:04.312722 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-bbceeb2c-6c74-4376-bf7c-cb8dd9b992b0 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:02:04.321604 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-bbceeb2c-6c74-4376-bf7c-cb8dd9b992b0 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d" status: 200 len: 1367 microversion: 2.1 time: 0.153661 Jul 05 13:02:04.322182 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 93/169] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:02:04 2022] GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:02:05.170599 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-40094935-4e00-4214-861d-2e06e9ad8822 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:02:05.171206 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-40094935-4e00-4214-861d-2e06e9ad8822 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:02:05.177276 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-40094935-4e00-4214-861d-2e06e9ad8822 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:05.177770 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-40094935-4e00-4214-861d-2e06e9ad8822 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:05.178573 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-40094935-4e00-4214-861d-2e06e9ad8822 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:05.179006 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-40094935-4e00-4214-861d-2e06e9ad8822 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:05.306966 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-40094935-4e00-4214-861d-2e06e9ad8822 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:02:05.314235 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-40094935-4e00-4214-861d-2e06e9ad8822 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1522 microversion: 2.1 time: 0.147646 Jul 05 13:02:05.314790 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 94/170] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:02:05 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:02:05.338879 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-13466958-e19c-4371-9c7b-ea223e778a09 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:02:05.339549 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-13466958-e19c-4371-9c7b-ea223e778a09 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 0f8f2957-1273-413b-ab2b-32da8868f70d] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:02:05.345207 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-13466958-e19c-4371-9c7b-ea223e778a09 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:05.345646 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-13466958-e19c-4371-9c7b-ea223e778a09 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:05.346386 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-13466958-e19c-4371-9c7b-ea223e778a09 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:05.346808 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-13466958-e19c-4371-9c7b-ea223e778a09 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:05.473729 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-13466958-e19c-4371-9c7b-ea223e778a09 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:02:05.481394 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-13466958-e19c-4371-9c7b-ea223e778a09 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d" status: 200 len: 1557 microversion: 2.1 time: 0.145959 Jul 05 13:02:05.481946 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 95/171] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:02:05 2022] GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d => generated 1557 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:02:05.501707 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-bc6a59d4-511f-4252-a66e-fade44f038a7 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:02:05.502186 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-bc6a59d4-511f-4252-a66e-fade44f038a7 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 0f8f2957-1273-413b-ab2b-32da8868f70d] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:02:05.508226 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-bc6a59d4-511f-4252-a66e-fade44f038a7 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:05.508693 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-bc6a59d4-511f-4252-a66e-fade44f038a7 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:05.509433 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-bc6a59d4-511f-4252-a66e-fade44f038a7 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:05.509859 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-bc6a59d4-511f-4252-a66e-fade44f038a7 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:05.585497 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-bc6a59d4-511f-4252-a66e-fade44f038a7 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087296 Jul 05 13:02:05.586109 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 96/172] 10.222.0.36 () {58 vars in 1274 bytes} [Tue Jul 5 13:02:05 2022] GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d/os-interface => generated 284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 13:02:06.330728 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-fe2482c4-e04d-4656-85ad-de95585e8a06 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:02:06.331347 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-fe2482c4-e04d-4656-85ad-de95585e8a06 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:02:06.337315 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-fe2482c4-e04d-4656-85ad-de95585e8a06 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:06.337761 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-fe2482c4-e04d-4656-85ad-de95585e8a06 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:06.338516 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-fe2482c4-e04d-4656-85ad-de95585e8a06 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:06.338945 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-fe2482c4-e04d-4656-85ad-de95585e8a06 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:06.568711 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-fe2482c4-e04d-4656-85ad-de95585e8a06 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:02:06.576081 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-fe2482c4-e04d-4656-85ad-de95585e8a06 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1522 microversion: 2.1 time: 0.249094 Jul 05 13:02:06.576666 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 97/173] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:02:06 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:02:07.058604 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [req-bb650daa-8244-4385-a457-34e2ff5c2bf3 req-63783e2d-7a38-4a18-a3ca-b9b7bee974c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f8f2957-1273-413b-ab2b-32da8868f70d", "tag": "ce361f6b-ae21-4c14-aee3-5bdf13b4b44f"}]} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:02:07.066654 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-bb650daa-8244-4385-a457-34e2ff5c2bf3 req-63783e2d-7a38-4a18-a3ca-b9b7bee974c8 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:07.067097 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-bb650daa-8244-4385-a457-34e2ff5c2bf3 req-63783e2d-7a38-4a18-a3ca-b9b7bee974c8 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:07.078278 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.compute.server_external_events [req-bb650daa-8244-4385-a457-34e2ff5c2bf3 req-63783e2d-7a38-4a18-a3ca-b9b7bee974c8 service nova] Creating event network-changed:ce361f6b-ae21-4c14-aee3-5bdf13b4b44f for instance 0f8f2957-1273-413b-ab2b-32da8868f70d on hv-cinder-79760 Jul 05 13:02:07.083374 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [req-bb650daa-8244-4385-a457-34e2ff5c2bf3 req-63783e2d-7a38-4a18-a3ca-b9b7bee974c8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028370 Jul 05 13:02:07.083993 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 98/174] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:02:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:02:07.594509 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-cd3ec91e-9a4d-4e0b-867a-e88b5797f5b9 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:02:07.595145 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-cd3ec91e-9a4d-4e0b-867a-e88b5797f5b9 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:02:07.602700 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-cd3ec91e-9a4d-4e0b-867a-e88b5797f5b9 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:07.603143 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-cd3ec91e-9a4d-4e0b-867a-e88b5797f5b9 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:07.603907 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-cd3ec91e-9a4d-4e0b-867a-e88b5797f5b9 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:07.604364 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-cd3ec91e-9a4d-4e0b-867a-e88b5797f5b9 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:07.739269 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-cd3ec91e-9a4d-4e0b-867a-e88b5797f5b9 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:02:07.746994 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-cd3ec91e-9a4d-4e0b-867a-e88b5797f5b9 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1522 microversion: 2.1 time: 0.156879 Jul 05 13:02:07.747569 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 99/175] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:02:07 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:02:08.660870 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_api:SELECT=73 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:08.764364 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-262b1e4f-b1b3-491b-bfea-e6aca678d6ed tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:02:08.765117 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-262b1e4f-b1b3-491b-bfea-e6aca678d6ed tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:02:08.771126 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-262b1e4f-b1b3-491b-bfea-e6aca678d6ed tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:08.771584 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-262b1e4f-b1b3-491b-bfea-e6aca678d6ed tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:08.772365 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-262b1e4f-b1b3-491b-bfea-e6aca678d6ed tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:08.772816 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-262b1e4f-b1b3-491b-bfea-e6aca678d6ed tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:08.921583 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-262b1e4f-b1b3-491b-bfea-e6aca678d6ed tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:02:08.932152 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-262b1e4f-b1b3-491b-bfea-e6aca678d6ed tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1522 microversion: 2.1 time: 0.171421 Jul 05 13:02:08.932803 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 100/176] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:02:08 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:02:09.199143 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-4e678441-588f-4174-9f0c-db37c9327e97 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] 10.222.0.36 "POST /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 10.549183 Jul 05 13:02:09.199873 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 77/177] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Jul 5 13:01:58 2022] POST /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a/os-volume_attachments => generated 194 bytes in 10551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 13:02:09.957683 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-caad10e2-bc95-44eb-8c28-a7b300072820 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:02:09.959811 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-caad10e2-bc95-44eb-8c28-a7b300072820 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:02:09.967941 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-caad10e2-bc95-44eb-8c28-a7b300072820 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:09.968697 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-caad10e2-bc95-44eb-8c28-a7b300072820 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:09.970189 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-caad10e2-bc95-44eb-8c28-a7b300072820 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:09.971061 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-caad10e2-bc95-44eb-8c28-a7b300072820 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:10.126491 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-caad10e2-bc95-44eb-8c28-a7b300072820 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:02:10.140891 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-caad10e2-bc95-44eb-8c28-a7b300072820 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1522 microversion: 2.1 time: 0.188924 Jul 05 13:02:10.141647 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 101/178] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:02:09 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:02:11.158873 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-519d09b0-2d5a-41d5-a5fa-cf94adb90693 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:02:11.159567 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-519d09b0-2d5a-41d5-a5fa-cf94adb90693 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:02:11.166319 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-519d09b0-2d5a-41d5-a5fa-cf94adb90693 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:11.166761 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-519d09b0-2d5a-41d5-a5fa-cf94adb90693 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:11.167506 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-519d09b0-2d5a-41d5-a5fa-cf94adb90693 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:11.167937 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-519d09b0-2d5a-41d5-a5fa-cf94adb90693 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:11.297306 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-519d09b0-2d5a-41d5-a5fa-cf94adb90693 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:02:11.305210 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-519d09b0-2d5a-41d5-a5fa-cf94adb90693 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1522 microversion: 2.1 time: 0.150949 Jul 05 13:02:11.305769 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 78/179] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:02:11 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:02:12.321875 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-e6e90ef6-9563-49bb-ae05-21dc563e9ee4 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:02:12.322493 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-e6e90ef6-9563-49bb-ae05-21dc563e9ee4 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:02:12.328505 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e6e90ef6-9563-49bb-ae05-21dc563e9ee4 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:12.328985 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e6e90ef6-9563-49bb-ae05-21dc563e9ee4 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:12.329741 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e6e90ef6-9563-49bb-ae05-21dc563e9ee4 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:12.330174 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e6e90ef6-9563-49bb-ae05-21dc563e9ee4 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:12.456193 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-e6e90ef6-9563-49bb-ae05-21dc563e9ee4 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:02:12.463626 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-e6e90ef6-9563-49bb-ae05-21dc563e9ee4 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1522 microversion: 2.1 time: 0.145516 Jul 05 13:02:12.464182 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 102/180] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:02:12 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:02:13.479943 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-13ff8dcc-4b59-4cdc-9ba4-b707d547047c tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:02:13.481218 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-13ff8dcc-4b59-4cdc-9ba4-b707d547047c tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:02:13.488378 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-13ff8dcc-4b59-4cdc-9ba4-b707d547047c tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:13.488767 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-13ff8dcc-4b59-4cdc-9ba4-b707d547047c tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:13.490115 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-13ff8dcc-4b59-4cdc-9ba4-b707d547047c tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:13.491163 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-13ff8dcc-4b59-4cdc-9ba4-b707d547047c tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:13.627581 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-13ff8dcc-4b59-4cdc-9ba4-b707d547047c tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:02:13.635622 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-13ff8dcc-4b59-4cdc-9ba4-b707d547047c tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1522 microversion: 2.1 time: 0.159722 Jul 05 13:02:13.636195 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 79/181] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:02:13 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:02:14.652838 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-44cfb46f-e7bb-4a9a-bfcc-55738aeace46 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:02:14.653483 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-44cfb46f-e7bb-4a9a-bfcc-55738aeace46 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:02:14.659587 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-44cfb46f-e7bb-4a9a-bfcc-55738aeace46 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:14.660345 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-44cfb46f-e7bb-4a9a-bfcc-55738aeace46 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:14.660872 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-44cfb46f-e7bb-4a9a-bfcc-55738aeace46 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:14.661354 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-44cfb46f-e7bb-4a9a-bfcc-55738aeace46 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:14.816651 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-44cfb46f-e7bb-4a9a-bfcc-55738aeace46 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:02:14.827528 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-44cfb46f-e7bb-4a9a-bfcc-55738aeace46 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1522 microversion: 2.1 time: 0.178343 Jul 05 13:02:14.832328 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 103/182] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:02:14 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:02:15.850002 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-0f0dda74-7446-4f48-9906-4d1fe87e5f87 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:02:15.850699 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-0f0dda74-7446-4f48-9906-4d1fe87e5f87 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:02:15.857550 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0f0dda74-7446-4f48-9906-4d1fe87e5f87 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:15.858002 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0f0dda74-7446-4f48-9906-4d1fe87e5f87 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:15.858772 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0f0dda74-7446-4f48-9906-4d1fe87e5f87 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:15.859213 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0f0dda74-7446-4f48-9906-4d1fe87e5f87 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:16.020770 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-0f0dda74-7446-4f48-9906-4d1fe87e5f87 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:02:16.032150 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-0f0dda74-7446-4f48-9906-4d1fe87e5f87 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1522 microversion: 2.1 time: 0.185781 Jul 05 13:02:16.033312 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 80/183] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:02:15 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:02:17.050279 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-acb6840d-ba99-407d-8749-fcdb85aa350d tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:02:17.050891 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-acb6840d-ba99-407d-8749-fcdb85aa350d tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:02:17.058400 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-acb6840d-ba99-407d-8749-fcdb85aa350d tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:17.064548 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-acb6840d-ba99-407d-8749-fcdb85aa350d tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:17.064548 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-acb6840d-ba99-407d-8749-fcdb85aa350d tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:17.064548 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-acb6840d-ba99-407d-8749-fcdb85aa350d tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:17.268490 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-acb6840d-ba99-407d-8749-fcdb85aa350d tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:02:17.276966 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-acb6840d-ba99-407d-8749-fcdb85aa350d tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1522 microversion: 2.1 time: 0.230601 Jul 05 13:02:17.277737 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 104/184] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:02:17 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:02:18.294213 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-c31272b2-2243-461a-8bed-f05e963594f6 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:02:18.299328 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-c31272b2-2243-461a-8bed-f05e963594f6 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:02:18.301254 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c31272b2-2243-461a-8bed-f05e963594f6 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:18.301765 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c31272b2-2243-461a-8bed-f05e963594f6 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:18.302519 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c31272b2-2243-461a-8bed-f05e963594f6 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:18.302946 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c31272b2-2243-461a-8bed-f05e963594f6 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:18.439374 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-c31272b2-2243-461a-8bed-f05e963594f6 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:02:18.447457 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-c31272b2-2243-461a-8bed-f05e963594f6 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1522 microversion: 2.1 time: 0.156994 Jul 05 13:02:18.447886 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 81/185] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:02:18 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:02:19.464065 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-1208389b-f69e-4c2c-8dc1-806b45c81185 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:02:19.464709 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-1208389b-f69e-4c2c-8dc1-806b45c81185 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:02:19.470712 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-1208389b-f69e-4c2c-8dc1-806b45c81185 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:19.471108 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-1208389b-f69e-4c2c-8dc1-806b45c81185 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:19.471863 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-1208389b-f69e-4c2c-8dc1-806b45c81185 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:19.472293 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-1208389b-f69e-4c2c-8dc1-806b45c81185 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:19.602986 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-1208389b-f69e-4c2c-8dc1-806b45c81185 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:02:19.610655 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-1208389b-f69e-4c2c-8dc1-806b45c81185 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1522 microversion: 2.1 time: 0.150304 Jul 05 13:02:19.619954 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 105/186] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:02:19 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:02:20.626709 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-6a508dd5-d6e0-4af1-908b-1d8d72da05cc tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:02:20.627376 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-6a508dd5-d6e0-4af1-908b-1d8d72da05cc tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:02:20.635993 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6a508dd5-d6e0-4af1-908b-1d8d72da05cc tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:20.636435 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6a508dd5-d6e0-4af1-908b-1d8d72da05cc tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:20.637353 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6a508dd5-d6e0-4af1-908b-1d8d72da05cc tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:20.637784 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6a508dd5-d6e0-4af1-908b-1d8d72da05cc tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:20.771552 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-6a508dd5-d6e0-4af1-908b-1d8d72da05cc tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:02:20.779209 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-6a508dd5-d6e0-4af1-908b-1d8d72da05cc tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1522 microversion: 2.1 time: 0.156497 Jul 05 13:02:20.779769 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 82/187] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:02:20 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:02:21.796516 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-0aeb080b-3498-485b-b942-858bb6cdf350 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:02:21.797236 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-0aeb080b-3498-485b-b942-858bb6cdf350 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:02:21.803695 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-0aeb080b-3498-485b-b942-858bb6cdf350 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:21.804142 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-0aeb080b-3498-485b-b942-858bb6cdf350 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:21.804924 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-0aeb080b-3498-485b-b942-858bb6cdf350 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:21.805352 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-0aeb080b-3498-485b-b942-858bb6cdf350 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:21.933725 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-0aeb080b-3498-485b-b942-858bb6cdf350 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:02:21.941054 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-0aeb080b-3498-485b-b942-858bb6cdf350 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1522 microversion: 2.1 time: 0.148308 Jul 05 13:02:21.941617 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 106/188] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:02:21 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:02:22.961215 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-6bbfe610-cdc9-481d-89dd-c4c9da90b8f1 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:02:22.961854 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-6bbfe610-cdc9-481d-89dd-c4c9da90b8f1 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:02:22.968338 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6bbfe610-cdc9-481d-89dd-c4c9da90b8f1 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:22.968817 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6bbfe610-cdc9-481d-89dd-c4c9da90b8f1 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:22.969572 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6bbfe610-cdc9-481d-89dd-c4c9da90b8f1 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:22.970002 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6bbfe610-cdc9-481d-89dd-c4c9da90b8f1 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:23.098156 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-6bbfe610-cdc9-481d-89dd-c4c9da90b8f1 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:02:23.105834 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-6bbfe610-cdc9-481d-89dd-c4c9da90b8f1 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1522 microversion: 2.1 time: 0.150669 Jul 05 13:02:23.106418 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 83/189] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:02:22 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:02:24.123120 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-cb098a5d-43eb-421e-a68b-e68df6ed15a0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:02:24.123737 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-cb098a5d-43eb-421e-a68b-e68df6ed15a0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:02:24.129948 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-cb098a5d-43eb-421e-a68b-e68df6ed15a0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:24.130392 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-cb098a5d-43eb-421e-a68b-e68df6ed15a0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:24.131177 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-cb098a5d-43eb-421e-a68b-e68df6ed15a0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:24.131604 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-cb098a5d-43eb-421e-a68b-e68df6ed15a0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:24.260952 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-cb098a5d-43eb-421e-a68b-e68df6ed15a0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:02:24.268355 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-cb098a5d-43eb-421e-a68b-e68df6ed15a0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1522 microversion: 2.1 time: 0.149435 Jul 05 13:02:24.268977 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 107/190] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:02:24 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:02:25.286496 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-6e21421e-dd8e-4343-99ea-315091bff8ef tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:02:25.287110 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-6e21421e-dd8e-4343-99ea-315091bff8ef tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:02:25.295763 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6e21421e-dd8e-4343-99ea-315091bff8ef tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:25.296207 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6e21421e-dd8e-4343-99ea-315091bff8ef tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:25.296998 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6e21421e-dd8e-4343-99ea-315091bff8ef tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:25.297436 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6e21421e-dd8e-4343-99ea-315091bff8ef tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:25.300287 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:25.469976 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-6e21421e-dd8e-4343-99ea-315091bff8ef tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:02:25.477814 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-6e21421e-dd8e-4343-99ea-315091bff8ef tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1522 microversion: 2.1 time: 0.196005 Jul 05 13:02:25.478379 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 84/191] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:02:25 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:02:25.734484 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-f383e5b4-1567-4732-9757-4de08fbf4c36 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:02:25.734966 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-f383e5b4-1567-4732-9757-4de08fbf4c36 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] [instance: 60d29496-d306-4d93-b1ca-23afb86dd55a] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:02:25.741511 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f383e5b4-1567-4732-9757-4de08fbf4c36 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:25.741954 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f383e5b4-1567-4732-9757-4de08fbf4c36 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:25.742775 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f383e5b4-1567-4732-9757-4de08fbf4c36 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:25.743269 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f383e5b4-1567-4732-9757-4de08fbf4c36 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:25.768248 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-f383e5b4-1567-4732-9757-4de08fbf4c36 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] [instance: 60d29496-d306-4d93-b1ca-23afb86dd55a] Going to try to terminate instance {{(pid=118386) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 13:02:25.796004 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_cell1:SELECT=100 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:26.142329 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-f383e5b4-1567-4732-9757-4de08fbf4c36 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] 10.222.0.36 "DELETE /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a" status: 204 len: 0 microversion: 2.1 time: 0.411665 Jul 05 13:02:26.142946 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 108/192] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jul 5 13:02:25 2022] DELETE /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a => generated 0 bytes in 413 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 05 13:02:26.151520 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-7dc608b4-e54d-4b80-b2b4-c0f735044860 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:02:26.152176 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-7dc608b4-e54d-4b80-b2b4-c0f735044860 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] [instance: 60d29496-d306-4d93-b1ca-23afb86dd55a] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:02:26.158985 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7dc608b4-e54d-4b80-b2b4-c0f735044860 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:26.159441 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7dc608b4-e54d-4b80-b2b4-c0f735044860 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:26.160199 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7dc608b4-e54d-4b80-b2b4-c0f735044860 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:26.160696 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7dc608b4-e54d-4b80-b2b4-c0f735044860 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:26.286649 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-7dc608b4-e54d-4b80-b2b4-c0f735044860 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac264b6684ae4c3f9fc8903163693d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d337ebe3a0475b9331780325e17451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:02:26.294780 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-7dc608b4-e54d-4b80-b2b4-c0f735044860 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] 10.222.0.36 "GET /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a" status: 200 len: 1552 microversion: 2.1 time: 0.147062 Jul 05 13:02:26.295343 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 85/193] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:02:26 2022] GET /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a => generated 1552 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:02:26.495872 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-4b08a1a9-003c-4769-928c-27ea2252eb4c tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:02:26.496566 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-4b08a1a9-003c-4769-928c-27ea2252eb4c tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:02:26.503129 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-4b08a1a9-003c-4769-928c-27ea2252eb4c tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:26.503661 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-4b08a1a9-003c-4769-928c-27ea2252eb4c tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:26.504991 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-4b08a1a9-003c-4769-928c-27ea2252eb4c tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:26.505425 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-4b08a1a9-003c-4769-928c-27ea2252eb4c tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:26.636890 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-4b08a1a9-003c-4769-928c-27ea2252eb4c tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:02:26.646215 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-4b08a1a9-003c-4769-928c-27ea2252eb4c tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1522 microversion: 2.1 time: 0.154612 Jul 05 13:02:26.648472 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 109/194] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:02:26 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:02:27.311610 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-eaddcb9f-839e-4b96-ab78-9007be12a955 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:02:27.312210 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-eaddcb9f-839e-4b96-ab78-9007be12a955 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] [instance: 60d29496-d306-4d93-b1ca-23afb86dd55a] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:02:27.318792 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-eaddcb9f-839e-4b96-ab78-9007be12a955 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:27.319247 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-eaddcb9f-839e-4b96-ab78-9007be12a955 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:27.320013 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-eaddcb9f-839e-4b96-ab78-9007be12a955 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:27.320453 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-eaddcb9f-839e-4b96-ab78-9007be12a955 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:27.464832 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-eaddcb9f-839e-4b96-ab78-9007be12a955 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac264b6684ae4c3f9fc8903163693d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d337ebe3a0475b9331780325e17451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:02:27.473597 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-eaddcb9f-839e-4b96-ab78-9007be12a955 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] 10.222.0.36 "GET /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a" status: 200 len: 1552 microversion: 2.1 time: 0.165741 Jul 05 13:02:27.474628 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 86/195] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:02:27 2022] GET /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a => generated 1552 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:02:27.664946 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-ccf99c8a-bf07-4f55-9de8-85fb0f03d366 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:02:27.665725 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-ccf99c8a-bf07-4f55-9de8-85fb0f03d366 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:02:27.672801 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ccf99c8a-bf07-4f55-9de8-85fb0f03d366 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:27.673245 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ccf99c8a-bf07-4f55-9de8-85fb0f03d366 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:27.674000 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ccf99c8a-bf07-4f55-9de8-85fb0f03d366 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:27.674656 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ccf99c8a-bf07-4f55-9de8-85fb0f03d366 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:27.809488 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-ccf99c8a-bf07-4f55-9de8-85fb0f03d366 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:02:27.816924 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-ccf99c8a-bf07-4f55-9de8-85fb0f03d366 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1522 microversion: 2.1 time: 0.157337 Jul 05 13:02:27.818930 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 110/196] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:02:27 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:02:28.491177 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-e94aea06-b11b-4ad4-9496-e2739f6c7f08 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:02:28.491822 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-e94aea06-b11b-4ad4-9496-e2739f6c7f08 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] [instance: 60d29496-d306-4d93-b1ca-23afb86dd55a] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:02:28.499286 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e94aea06-b11b-4ad4-9496-e2739f6c7f08 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:28.499735 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e94aea06-b11b-4ad4-9496-e2739f6c7f08 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:28.500507 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e94aea06-b11b-4ad4-9496-e2739f6c7f08 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:28.500981 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e94aea06-b11b-4ad4-9496-e2739f6c7f08 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:28.641891 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-e94aea06-b11b-4ad4-9496-e2739f6c7f08 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac264b6684ae4c3f9fc8903163693d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d337ebe3a0475b9331780325e17451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:02:28.650268 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-e94aea06-b11b-4ad4-9496-e2739f6c7f08 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] 10.222.0.36 "GET /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a" status: 200 len: 1552 microversion: 2.1 time: 0.162964 Jul 05 13:02:28.650877 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 87/197] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:02:28 2022] GET /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a => generated 1552 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:02:28.836025 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-dced3eeb-7ab1-43ea-a035-039a6ecd3b49 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:02:28.837887 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-dced3eeb-7ab1-43ea-a035-039a6ecd3b49 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:02:28.854095 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-dced3eeb-7ab1-43ea-a035-039a6ecd3b49 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:28.855063 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-dced3eeb-7ab1-43ea-a035-039a6ecd3b49 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:28.856374 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-dced3eeb-7ab1-43ea-a035-039a6ecd3b49 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:28.857066 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-dced3eeb-7ab1-43ea-a035-039a6ecd3b49 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:29.062914 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-dced3eeb-7ab1-43ea-a035-039a6ecd3b49 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:02:29.072925 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-dced3eeb-7ab1-43ea-a035-039a6ecd3b49 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1522 microversion: 2.1 time: 0.242735 Jul 05 13:02:29.084610 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 111/198] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:02:28 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1522 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:02:29.670035 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-39562a4a-fc59-4a98-a6eb-74ab9c337459 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:02:29.670035 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-39562a4a-fc59-4a98-a6eb-74ab9c337459 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] [instance: 60d29496-d306-4d93-b1ca-23afb86dd55a] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:02:29.670666 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [req-996d05d4-e703-40b1-ae47-96826128bd1d req-85e15305-cae7-482c-a343-f82c1a7df0ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60d29496-d306-4d93-b1ca-23afb86dd55a", "name": "network-vif-deleted", "tag": "41a618a8-294c-42b1-90ce-4aa0a088ade4"}]} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:02:29.679017 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-39562a4a-fc59-4a98-a6eb-74ab9c337459 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:29.680095 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-39562a4a-fc59-4a98-a6eb-74ab9c337459 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:29.681169 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-39562a4a-fc59-4a98-a6eb-74ab9c337459 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:29.682013 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-996d05d4-e703-40b1-ae47-96826128bd1d req-85e15305-cae7-482c-a343-f82c1a7df0ee service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:29.682664 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-39562a4a-fc59-4a98-a6eb-74ab9c337459 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:29.683428 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-996d05d4-e703-40b1-ae47-96826128bd1d req-85e15305-cae7-482c-a343-f82c1a7df0ee service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:29.705967 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.compute.server_external_events [req-996d05d4-e703-40b1-ae47-96826128bd1d req-85e15305-cae7-482c-a343-f82c1a7df0ee service nova] Creating event network-vif-deleted:41a618a8-294c-42b1-90ce-4aa0a088ade4 for instance 60d29496-d306-4d93-b1ca-23afb86dd55a on hv-cinder-79760 Jul 05 13:02:29.715550 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [req-996d05d4-e703-40b1-ae47-96826128bd1d req-85e15305-cae7-482c-a343-f82c1a7df0ee service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051516 Jul 05 13:02:29.717876 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 112/199] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:02:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:02:29.814607 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-39562a4a-fc59-4a98-a6eb-74ab9c337459 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac264b6684ae4c3f9fc8903163693d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d337ebe3a0475b9331780325e17451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:02:29.825022 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-39562a4a-fc59-4a98-a6eb-74ab9c337459 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] 10.222.0.36 "GET /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a" status: 200 len: 1510 microversion: 2.1 time: 0.161404 Jul 05 13:02:29.825691 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 88/200] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:02:29 2022] GET /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a => generated 1510 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:02:30.090786 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-54ebc0f3-d11b-4e0c-a123-59d0925f2161 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:02:30.091491 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-54ebc0f3-d11b-4e0c-a123-59d0925f2161 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:02:30.102639 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-54ebc0f3-d11b-4e0c-a123-59d0925f2161 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:30.103341 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-54ebc0f3-d11b-4e0c-a123-59d0925f2161 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:30.104653 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-54ebc0f3-d11b-4e0c-a123-59d0925f2161 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:30.105572 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-54ebc0f3-d11b-4e0c-a123-59d0925f2161 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:30.303816 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-54ebc0f3-d11b-4e0c-a123-59d0925f2161 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:02:30.312892 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-54ebc0f3-d11b-4e0c-a123-59d0925f2161 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1522 microversion: 2.1 time: 0.226596 Jul 05 13:02:30.314036 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 113/201] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:02:30 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:02:30.845539 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-d646359e-1472-43f1-976a-01412dee7dc0 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:02:30.847116 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-d646359e-1472-43f1-976a-01412dee7dc0 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] [instance: 60d29496-d306-4d93-b1ca-23afb86dd55a] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:02:30.855960 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d646359e-1472-43f1-976a-01412dee7dc0 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:30.856700 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d646359e-1472-43f1-976a-01412dee7dc0 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:30.857633 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d646359e-1472-43f1-976a-01412dee7dc0 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:30.861332 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d646359e-1472-43f1-976a-01412dee7dc0 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:30.901487 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d646359e-1472-43f1-976a-01412dee7dc0 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:30.902248 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d646359e-1472-43f1-976a-01412dee7dc0 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:30.903016 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.objects.instance [None req-d646359e-1472-43f1-976a-01412dee7dc0 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lazy-loading 'fault' on Instance uuid 60d29496-d306-4d93-b1ca-23afb86dd55a {{(pid=118387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 13:02:30.948237 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-d646359e-1472-43f1-976a-01412dee7dc0 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac264b6684ae4c3f9fc8903163693d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d337ebe3a0475b9331780325e17451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:02:30.956417 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-d646359e-1472-43f1-976a-01412dee7dc0 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] 10.222.0.36 "GET /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a" status: 200 len: 1351 microversion: 2.1 time: 0.117273 Jul 05 13:02:30.957023 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 89/202] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:02:30 2022] GET /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a => generated 1351 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:02:31.329541 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-03621352-11e9-48b7-bea6-145d15090800 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:02:31.330084 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-03621352-11e9-48b7-bea6-145d15090800 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:02:31.332019 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:31.337363 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-03621352-11e9-48b7-bea6-145d15090800 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:31.337815 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-03621352-11e9-48b7-bea6-145d15090800 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:31.338568 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-03621352-11e9-48b7-bea6-145d15090800 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:31.339000 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-03621352-11e9-48b7-bea6-145d15090800 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:31.538285 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-03621352-11e9-48b7-bea6-145d15090800 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:02:31.546320 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-03621352-11e9-48b7-bea6-145d15090800 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1522 microversion: 2.1 time: 0.220683 Jul 05 13:02:31.546893 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 114/203] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:02:31 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:02:31.975309 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-5ba5d0e9-1862-4ee2-ba87-87e86562a04b tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:02:31.976015 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-5ba5d0e9-1862-4ee2-ba87-87e86562a04b tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] [instance: 60d29496-d306-4d93-b1ca-23afb86dd55a] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:02:31.983092 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5ba5d0e9-1862-4ee2-ba87-87e86562a04b tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:31.983716 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5ba5d0e9-1862-4ee2-ba87-87e86562a04b tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:31.991600 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5ba5d0e9-1862-4ee2-ba87-87e86562a04b tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:31.992059 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5ba5d0e9-1862-4ee2-ba87-87e86562a04b tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:32.011832 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.wsgi [None req-5ba5d0e9-1862-4ee2-ba87-87e86562a04b tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] HTTP exception thrown: Instance 60d29496-d306-4d93-b1ca-23afb86dd55a could not be found. Jul 05 13:02:32.017759 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-5ba5d0e9-1862-4ee2-ba87-87e86562a04b tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Request method failure captured: Jul 05 13:02:32.017759 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: request: GET /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a HTTP/1.1 Jul 05 13:02:32.017759 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept: application/json Jul 05 13:02:32.017759 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept-Encoding: identity Jul 05 13:02:32.017759 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Connection: close Jul 05 13:02:32.017759 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Length: 0 Jul 05 13:02:32.017759 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Type: application/json Jul 05 13:02:32.017759 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Host: 10.222.0.36 Jul 05 13:02:32.017759 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Openstack-System-Scope: None Jul 05 13:02:32.017759 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: User-Agent: python-urllib3/1.26.9 Jul 05 13:02:32.017759 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Auth-Token: gAAAAABixDYYlGzZwwT67d37ld7o9w4PrfR0679zflzxsNo6aBgXkT_vJSZKL7f47_s1gZQTaBHplNUF3olMqZxQLfDhpnaTBUCqlaJGaECC-tQJ5IItvhuOebhN87KwujQWoRrNKdDvNbj32hw3zz14qvQE23lzDNDO-35zFr7mFq0O1a76FJ0 Jul 05 13:02:32.017759 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Id: None Jul 05 13:02:32.017759 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Name: None Jul 05 13:02:32.017759 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Identity-Status: Confirmed Jul 05 13:02:32.017759 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Is-Admin-Project: True Jul 05 13:02:32.017759 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Id: default Jul 05 13:02:32.017759 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Name: Default Jul 05 13:02:32.017759 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Id: 79d337ebe3a0475b9331780325e17451 Jul 05 13:02:32.017759 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Name: tempest-DeleteServersTestJSON-1856167100 Jul 05 13:02:32.017759 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Role: member,reader Jul 05 13:02:32.017759 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Roles: member,reader Jul 05 13:02:32.019394 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/79d337ebe3a0475b9331780325e17451"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_79d337ebe3a0475b9331780325e17451", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/79d337ebe3a0475b9331780325e17451"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/79d337ebe3a0475b9331780325e17451"}]}] Jul 05 13:02:32.019394 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant: tempest-DeleteServersTestJSON-1856167100 Jul 05 13:02:32.019394 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Id: 79d337ebe3a0475b9331780325e17451 Jul 05 13:02:32.019394 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Name: tempest-DeleteServersTestJSON-1856167100 Jul 05 13:02:32.019394 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User: tempest-DeleteServersTestJSON-1856167100-project Jul 05 13:02:32.019394 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Id: default Jul 05 13:02:32.019394 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Name: Default Jul 05 13:02:32.019394 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Id: ac264b6684ae4c3f9fc8903163693d6f Jul 05 13:02:32.019394 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Name: tempest-DeleteServersTestJSON-1856167100-project Jul 05 13:02:32.019394 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: method: > Jul 05 13:02:32.019394 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: exception: Instance 60d29496-d306-4d93-b1ca-23afb86dd55a could not be found. Jul 05 13:02:32.019394 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: action_args: {'id': '60d29496-d306-4d93-b1ca-23afb86dd55a'} Jul 05 13:02:32.020194 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 13:02:32.020194 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:02:32.020194 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 13:02:32.020194 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 13:02:32.020194 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 13:02:32.020194 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 13:02:32.020194 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 13:02:32.020194 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 13:02:32.020194 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 13:02:32.020194 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 13:02:32.020194 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60d29496-d306-4d93-b1ca-23afb86dd55a could not be found. Jul 05 13:02:32.020194 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:02:32.020194 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:02:32.020194 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:02:32.020194 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:02:32.020194 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:02:32.020194 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:02:32.020194 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 13:02:32.020194 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 13:02:32.020194 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 13:02:32.021386 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 13:02:32.021386 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 13:02:32.021386 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 13:02:32.021386 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 13:02:32.021386 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 13:02:32.021386 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 13:02:32.021386 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 13:02:32.021386 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60d29496-d306-4d93-b1ca-23afb86dd55a could not be found. Jul 05 13:02:32.021386 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:02:32.021386 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:02:32.021386 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:02:32.021386 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:02:32.021386 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:02:32.021386 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:02:32.021386 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 13:02:32.021386 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 13:02:32.021386 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60d29496-d306-4d93-b1ca-23afb86dd55a could not be found. Jul 05 13:02:32.021386 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:02:32.022597 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-5ba5d0e9-1862-4ee2-ba87-87e86562a04b tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Returning 404 to user: Instance 60d29496-d306-4d93-b1ca-23afb86dd55a could not be found. {{(pid=118387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 13:02:32.022597 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-5ba5d0e9-1862-4ee2-ba87-87e86562a04b tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] 10.222.0.36 "GET /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a" status: 404 len: 111 microversion: 2.1 time: 0.049056 Jul 05 13:02:32.022597 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 90/204] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:02:31 2022] GET /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 13:02:32.162255 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-7c4c4193-1d09-45ee-b880-ef74fe474283 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:02:32.163784 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-7c4c4193-1d09-45ee-b880-ef74fe474283 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] [instance: 60d29496-d306-4d93-b1ca-23afb86dd55a] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:02:32.170318 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-7c4c4193-1d09-45ee-b880-ef74fe474283 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:32.170868 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-7c4c4193-1d09-45ee-b880-ef74fe474283 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:32.171860 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-7c4c4193-1d09-45ee-b880-ef74fe474283 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:32.172386 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-7c4c4193-1d09-45ee-b880-ef74fe474283 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:32.188903 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.wsgi [None req-7c4c4193-1d09-45ee-b880-ef74fe474283 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] HTTP exception thrown: Instance 60d29496-d306-4d93-b1ca-23afb86dd55a could not be found. Jul 05 13:02:32.220836 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-7c4c4193-1d09-45ee-b880-ef74fe474283 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Request method failure captured: Jul 05 13:02:32.220836 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: request: GET /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a/os-volume_attachments HTTP/1.1 Jul 05 13:02:32.220836 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Accept: application/json Jul 05 13:02:32.220836 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Accept-Encoding: identity Jul 05 13:02:32.220836 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Connection: close Jul 05 13:02:32.220836 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Content-Length: 0 Jul 05 13:02:32.220836 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Content-Type: application/json Jul 05 13:02:32.220836 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Host: 10.222.0.36 Jul 05 13:02:32.220836 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Openstack-System-Scope: None Jul 05 13:02:32.220836 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: User-Agent: python-urllib3/1.26.9 Jul 05 13:02:32.220836 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Auth-Token: gAAAAABixDYYlGzZwwT67d37ld7o9w4PrfR0679zflzxsNo6aBgXkT_vJSZKL7f47_s1gZQTaBHplNUF3olMqZxQLfDhpnaTBUCqlaJGaECC-tQJ5IItvhuOebhN87KwujQWoRrNKdDvNbj32hw3zz14qvQE23lzDNDO-35zFr7mFq0O1a76FJ0 Jul 05 13:02:32.220836 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Domain-Id: None Jul 05 13:02:32.220836 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Domain-Name: None Jul 05 13:02:32.220836 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Identity-Status: Confirmed Jul 05 13:02:32.220836 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Is-Admin-Project: True Jul 05 13:02:32.220836 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Domain-Id: default Jul 05 13:02:32.220836 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Domain-Name: Default Jul 05 13:02:32.220836 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Id: 79d337ebe3a0475b9331780325e17451 Jul 05 13:02:32.220836 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Name: tempest-DeleteServersTestJSON-1856167100 Jul 05 13:02:32.220836 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Role: member,reader Jul 05 13:02:32.220836 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Roles: member,reader Jul 05 13:02:32.225939 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/79d337ebe3a0475b9331780325e17451"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_79d337ebe3a0475b9331780325e17451", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/79d337ebe3a0475b9331780325e17451"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/79d337ebe3a0475b9331780325e17451"}]}] Jul 05 13:02:32.225939 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Tenant: tempest-DeleteServersTestJSON-1856167100 Jul 05 13:02:32.225939 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Tenant-Id: 79d337ebe3a0475b9331780325e17451 Jul 05 13:02:32.225939 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Tenant-Name: tempest-DeleteServersTestJSON-1856167100 Jul 05 13:02:32.225939 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User: tempest-DeleteServersTestJSON-1856167100-project Jul 05 13:02:32.225939 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Domain-Id: default Jul 05 13:02:32.225939 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Domain-Name: Default Jul 05 13:02:32.225939 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Id: ac264b6684ae4c3f9fc8903163693d6f Jul 05 13:02:32.225939 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Name: tempest-DeleteServersTestJSON-1856167100-project Jul 05 13:02:32.225939 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: method: > Jul 05 13:02:32.225939 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: exception: Instance 60d29496-d306-4d93-b1ca-23afb86dd55a could not be found. Jul 05 13:02:32.225939 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: action_args: {'server_id': '60d29496-d306-4d93-b1ca-23afb86dd55a'} Jul 05 13:02:32.226679 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 13:02:32.226679 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:02:32.226679 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 13:02:32.226679 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 13:02:32.226679 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 13:02:32.226679 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 13:02:32.226679 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 13:02:32.226679 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 13:02:32.226679 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 13:02:32.226679 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 13:02:32.226679 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60d29496-d306-4d93-b1ca-23afb86dd55a could not be found. Jul 05 13:02:32.226679 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:02:32.226679 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:02:32.226679 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:02:32.226679 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:02:32.226679 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:02:32.226679 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:02:32.226679 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 13:02:32.226679 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 13:02:32.226679 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 13:02:32.228032 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 13:02:32.228032 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 05 13:02:32.228032 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 05 13:02:32.228032 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 05 13:02:32.228032 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 05 13:02:32.228032 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 05 13:02:32.228032 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 05 13:02:32.228032 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 13:02:32.228032 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 13:02:32.228032 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60d29496-d306-4d93-b1ca-23afb86dd55a could not be found. Jul 05 13:02:32.228032 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:02:32.228032 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:02:32.228032 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:02:32.228032 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:02:32.228032 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:02:32.228032 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:02:32.228032 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 13:02:32.228032 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 13:02:32.228032 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60d29496-d306-4d93-b1ca-23afb86dd55a could not be found. Jul 05 13:02:32.228032 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:02:32.229220 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-7c4c4193-1d09-45ee-b880-ef74fe474283 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Returning 404 to user: Instance 60d29496-d306-4d93-b1ca-23afb86dd55a could not be found. {{(pid=118386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 13:02:32.229220 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-7c4c4193-1d09-45ee-b880-ef74fe474283 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] 10.222.0.36 "GET /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.066304 Jul 05 13:02:32.229220 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 115/205] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jul 5 13:02:32 2022] GET /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a/os-volume_attachments => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 13:02:32.563817 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-553746fb-9a26-40ea-8849-6e7243ad5ecd tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:02:32.564575 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-553746fb-9a26-40ea-8849-6e7243ad5ecd tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:02:32.578452 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-553746fb-9a26-40ea-8849-6e7243ad5ecd tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:32.578452 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-553746fb-9a26-40ea-8849-6e7243ad5ecd tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:32.578452 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-553746fb-9a26-40ea-8849-6e7243ad5ecd tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:32.578452 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-553746fb-9a26-40ea-8849-6e7243ad5ecd tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:32.748362 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-553746fb-9a26-40ea-8849-6e7243ad5ecd tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:02:32.760794 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-553746fb-9a26-40ea-8849-6e7243ad5ecd tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1522 microversion: 2.1 time: 0.200867 Jul 05 13:02:32.763747 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 91/206] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:02:32 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:02:33.786279 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-6e7df7fc-c1b3-4947-b4c7-53571132cc2c tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:02:33.786881 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-6e7df7fc-c1b3-4947-b4c7-53571132cc2c tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:02:33.793279 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-6e7df7fc-c1b3-4947-b4c7-53571132cc2c tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:33.794707 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-6e7df7fc-c1b3-4947-b4c7-53571132cc2c tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:33.795829 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-6e7df7fc-c1b3-4947-b4c7-53571132cc2c tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:33.796265 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-6e7df7fc-c1b3-4947-b4c7-53571132cc2c tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:33.840161 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-827f6ce3-886d-4c2b-9a69-45b59a3d4df3 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:02:33.840683 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-827f6ce3-886d-4c2b-9a69-45b59a3d4df3 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] [instance: 60d29496-d306-4d93-b1ca-23afb86dd55a] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:02:33.847403 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-827f6ce3-886d-4c2b-9a69-45b59a3d4df3 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:33.848506 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-827f6ce3-886d-4c2b-9a69-45b59a3d4df3 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:33.849309 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-827f6ce3-886d-4c2b-9a69-45b59a3d4df3 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:33.849744 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-827f6ce3-886d-4c2b-9a69-45b59a3d4df3 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:33.867094 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.wsgi [None req-827f6ce3-886d-4c2b-9a69-45b59a3d4df3 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] HTTP exception thrown: Instance 60d29496-d306-4d93-b1ca-23afb86dd55a could not be found. Jul 05 13:02:33.868846 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-827f6ce3-886d-4c2b-9a69-45b59a3d4df3 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Request method failure captured: Jul 05 13:02:33.868846 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: request: DELETE /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a HTTP/1.1 Jul 05 13:02:33.868846 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept: application/json Jul 05 13:02:33.868846 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept-Encoding: identity Jul 05 13:02:33.868846 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Connection: close Jul 05 13:02:33.868846 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Length: 0 Jul 05 13:02:33.868846 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Type: application/json Jul 05 13:02:33.868846 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Host: 10.222.0.36 Jul 05 13:02:33.868846 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Openstack-System-Scope: None Jul 05 13:02:33.868846 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: User-Agent: python-urllib3/1.26.9 Jul 05 13:02:33.868846 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Auth-Token: gAAAAABixDYYlGzZwwT67d37ld7o9w4PrfR0679zflzxsNo6aBgXkT_vJSZKL7f47_s1gZQTaBHplNUF3olMqZxQLfDhpnaTBUCqlaJGaECC-tQJ5IItvhuOebhN87KwujQWoRrNKdDvNbj32hw3zz14qvQE23lzDNDO-35zFr7mFq0O1a76FJ0 Jul 05 13:02:33.868846 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Id: None Jul 05 13:02:33.868846 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Name: None Jul 05 13:02:33.868846 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Identity-Status: Confirmed Jul 05 13:02:33.868846 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Is-Admin-Project: True Jul 05 13:02:33.868846 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Id: default Jul 05 13:02:33.868846 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Name: Default Jul 05 13:02:33.868846 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Id: 79d337ebe3a0475b9331780325e17451 Jul 05 13:02:33.868846 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Name: tempest-DeleteServersTestJSON-1856167100 Jul 05 13:02:33.868846 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Role: member,reader Jul 05 13:02:33.868846 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Roles: member,reader Jul 05 13:02:33.870296 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/79d337ebe3a0475b9331780325e17451"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_79d337ebe3a0475b9331780325e17451", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/79d337ebe3a0475b9331780325e17451"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/79d337ebe3a0475b9331780325e17451"}]}] Jul 05 13:02:33.870296 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant: tempest-DeleteServersTestJSON-1856167100 Jul 05 13:02:33.870296 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Id: 79d337ebe3a0475b9331780325e17451 Jul 05 13:02:33.870296 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Name: tempest-DeleteServersTestJSON-1856167100 Jul 05 13:02:33.870296 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User: tempest-DeleteServersTestJSON-1856167100-project Jul 05 13:02:33.870296 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Id: default Jul 05 13:02:33.870296 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Name: Default Jul 05 13:02:33.870296 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Id: ac264b6684ae4c3f9fc8903163693d6f Jul 05 13:02:33.870296 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Name: tempest-DeleteServersTestJSON-1856167100-project Jul 05 13:02:33.870296 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: method: > Jul 05 13:02:33.870296 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: exception: Instance 60d29496-d306-4d93-b1ca-23afb86dd55a could not be found. Jul 05 13:02:33.870296 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: action_args: {'id': '60d29496-d306-4d93-b1ca-23afb86dd55a'} Jul 05 13:02:33.871080 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 13:02:33.871080 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:02:33.871080 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 13:02:33.871080 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 13:02:33.871080 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 13:02:33.871080 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 13:02:33.871080 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 13:02:33.871080 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 13:02:33.871080 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 13:02:33.871080 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 13:02:33.871080 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60d29496-d306-4d93-b1ca-23afb86dd55a could not be found. Jul 05 13:02:33.871080 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:02:33.871080 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:02:33.871080 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:02:33.871080 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:02:33.871080 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:02:33.871080 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:02:33.871080 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 13:02:33.871080 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 13:02:33.871080 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 13:02:33.872470 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 13:02:33.872470 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 05 13:02:33.872470 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 05 13:02:33.872470 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 05 13:02:33.872470 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 05 13:02:33.872470 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 13:02:33.872470 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 13:02:33.872470 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 13:02:33.872470 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 13:02:33.872470 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60d29496-d306-4d93-b1ca-23afb86dd55a could not be found. Jul 05 13:02:33.872470 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:02:33.872470 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:02:33.872470 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:02:33.872470 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:02:33.872470 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:02:33.872470 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:02:33.872470 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 13:02:33.872470 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 13:02:33.872470 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60d29496-d306-4d93-b1ca-23afb86dd55a could not be found. Jul 05 13:02:33.872470 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:02:33.874536 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-827f6ce3-886d-4c2b-9a69-45b59a3d4df3 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Returning 404 to user: Instance 60d29496-d306-4d93-b1ca-23afb86dd55a could not be found. {{(pid=118387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 13:02:33.875537 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-827f6ce3-886d-4c2b-9a69-45b59a3d4df3 tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] 10.222.0.36 "DELETE /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a" status: 404 len: 111 microversion: 2.1 time: 0.039406 Jul 05 13:02:33.876092 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 92/207] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jul 5 13:02:33 2022] DELETE /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 05 13:02:33.886830 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-b8f737de-546a-4da1-9520-a3a62ad637be tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:02:33.887543 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-b8f737de-546a-4da1-9520-a3a62ad637be tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] [instance: 60d29496-d306-4d93-b1ca-23afb86dd55a] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:02:33.902332 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b8f737de-546a-4da1-9520-a3a62ad637be tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:33.902780 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b8f737de-546a-4da1-9520-a3a62ad637be tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:33.903546 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b8f737de-546a-4da1-9520-a3a62ad637be tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:33.903983 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b8f737de-546a-4da1-9520-a3a62ad637be tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:33.925796 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.wsgi [None req-b8f737de-546a-4da1-9520-a3a62ad637be tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] HTTP exception thrown: Instance 60d29496-d306-4d93-b1ca-23afb86dd55a could not be found. Jul 05 13:02:33.927392 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-b8f737de-546a-4da1-9520-a3a62ad637be tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Request method failure captured: Jul 05 13:02:33.927392 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: request: GET /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a HTTP/1.1 Jul 05 13:02:33.927392 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept: application/json Jul 05 13:02:33.927392 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept-Encoding: identity Jul 05 13:02:33.927392 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Connection: close Jul 05 13:02:33.927392 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Length: 0 Jul 05 13:02:33.927392 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Type: application/json Jul 05 13:02:33.927392 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Host: 10.222.0.36 Jul 05 13:02:33.927392 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Openstack-System-Scope: None Jul 05 13:02:33.927392 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: User-Agent: python-urllib3/1.26.9 Jul 05 13:02:33.927392 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Auth-Token: gAAAAABixDYYlGzZwwT67d37ld7o9w4PrfR0679zflzxsNo6aBgXkT_vJSZKL7f47_s1gZQTaBHplNUF3olMqZxQLfDhpnaTBUCqlaJGaECC-tQJ5IItvhuOebhN87KwujQWoRrNKdDvNbj32hw3zz14qvQE23lzDNDO-35zFr7mFq0O1a76FJ0 Jul 05 13:02:33.927392 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Id: None Jul 05 13:02:33.927392 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Name: None Jul 05 13:02:33.927392 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Identity-Status: Confirmed Jul 05 13:02:33.927392 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Is-Admin-Project: True Jul 05 13:02:33.927392 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Id: default Jul 05 13:02:33.927392 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Name: Default Jul 05 13:02:33.927392 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Id: 79d337ebe3a0475b9331780325e17451 Jul 05 13:02:33.927392 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Name: tempest-DeleteServersTestJSON-1856167100 Jul 05 13:02:33.927392 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Role: member,reader Jul 05 13:02:33.927392 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Roles: member,reader Jul 05 13:02:33.928886 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/79d337ebe3a0475b9331780325e17451"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_79d337ebe3a0475b9331780325e17451", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/79d337ebe3a0475b9331780325e17451"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/79d337ebe3a0475b9331780325e17451"}]}] Jul 05 13:02:33.928886 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant: tempest-DeleteServersTestJSON-1856167100 Jul 05 13:02:33.928886 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Id: 79d337ebe3a0475b9331780325e17451 Jul 05 13:02:33.928886 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Name: tempest-DeleteServersTestJSON-1856167100 Jul 05 13:02:33.928886 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User: tempest-DeleteServersTestJSON-1856167100-project Jul 05 13:02:33.928886 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Id: default Jul 05 13:02:33.928886 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Name: Default Jul 05 13:02:33.928886 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Id: ac264b6684ae4c3f9fc8903163693d6f Jul 05 13:02:33.928886 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Name: tempest-DeleteServersTestJSON-1856167100-project Jul 05 13:02:33.928886 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: method: > Jul 05 13:02:33.928886 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: exception: Instance 60d29496-d306-4d93-b1ca-23afb86dd55a could not be found. Jul 05 13:02:33.928886 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: action_args: {'id': '60d29496-d306-4d93-b1ca-23afb86dd55a'} Jul 05 13:02:33.929709 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 13:02:33.929709 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:02:33.929709 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 13:02:33.929709 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 13:02:33.929709 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 13:02:33.929709 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 13:02:33.929709 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 13:02:33.929709 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 13:02:33.929709 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 13:02:33.929709 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 13:02:33.929709 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60d29496-d306-4d93-b1ca-23afb86dd55a could not be found. Jul 05 13:02:33.929709 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:02:33.929709 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:02:33.929709 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:02:33.929709 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:02:33.929709 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:02:33.929709 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:02:33.929709 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 13:02:33.929709 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 13:02:33.929709 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 13:02:33.937189 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 13:02:33.937189 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 13:02:33.937189 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 13:02:33.937189 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 13:02:33.937189 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 13:02:33.937189 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 13:02:33.937189 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 13:02:33.937189 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60d29496-d306-4d93-b1ca-23afb86dd55a could not be found. Jul 05 13:02:33.937189 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:02:33.937189 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:02:33.937189 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:02:33.937189 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:02:33.937189 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:02:33.937189 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:02:33.937189 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 13:02:33.937189 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 13:02:33.937189 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60d29496-d306-4d93-b1ca-23afb86dd55a could not be found. Jul 05 13:02:33.937189 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:02:33.938318 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-b8f737de-546a-4da1-9520-a3a62ad637be tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] Returning 404 to user: Instance 60d29496-d306-4d93-b1ca-23afb86dd55a could not be found. {{(pid=118387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 13:02:33.938318 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-b8f737de-546a-4da1-9520-a3a62ad637be tempest-DeleteServersTestJSON-1856167100 tempest-DeleteServersTestJSON-1856167100-project] 10.222.0.36 "GET /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a" status: 404 len: 111 microversion: 2.1 time: 0.047579 Jul 05 13:02:33.938318 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 93/208] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:02:33 2022] GET /compute/v2.1/servers/60d29496-d306-4d93-b1ca-23afb86dd55a => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 13:02:34.016146 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-6e7df7fc-c1b3-4947-b4c7-53571132cc2c tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:02:34.024701 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-6e7df7fc-c1b3-4947-b4c7-53571132cc2c tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1522 microversion: 2.1 time: 0.243335 Jul 05 13:02:34.025842 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 116/209] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:02:33 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:02:35.042025 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-ce0be0ee-5247-4410-9b36-1947a47ff847 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:02:35.049769 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-ce0be0ee-5247-4410-9b36-1947a47ff847 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:02:35.052423 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ce0be0ee-5247-4410-9b36-1947a47ff847 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:35.055939 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ce0be0ee-5247-4410-9b36-1947a47ff847 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:35.058143 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ce0be0ee-5247-4410-9b36-1947a47ff847 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:35.058705 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ce0be0ee-5247-4410-9b36-1947a47ff847 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:35.214602 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-ce0be0ee-5247-4410-9b36-1947a47ff847 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:02:35.221992 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-ce0be0ee-5247-4410-9b36-1947a47ff847 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1522 microversion: 2.1 time: 0.183870 Jul 05 13:02:35.222554 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 94/210] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:02:35 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:02:36.239149 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-7ee23ea7-7648-444c-a36d-72122a76fee5 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:02:36.239820 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-7ee23ea7-7648-444c-a36d-72122a76fee5 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:02:36.246766 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-7ee23ea7-7648-444c-a36d-72122a76fee5 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:36.247210 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-7ee23ea7-7648-444c-a36d-72122a76fee5 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:36.249269 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-7ee23ea7-7648-444c-a36d-72122a76fee5 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:36.250809 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-7ee23ea7-7648-444c-a36d-72122a76fee5 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:36.429128 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-7ee23ea7-7648-444c-a36d-72122a76fee5 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:02:36.455537 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-7ee23ea7-7648-444c-a36d-72122a76fee5 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1522 microversion: 2.1 time: 0.215133 Jul 05 13:02:36.456196 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 117/211] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:02:36 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:02:37.472125 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-969b9f5d-0642-4919-aa78-c3721fbb351a tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:02:37.472924 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-969b9f5d-0642-4919-aa78-c3721fbb351a tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:02:37.489908 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-969b9f5d-0642-4919-aa78-c3721fbb351a tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:37.490370 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-969b9f5d-0642-4919-aa78-c3721fbb351a tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:37.491166 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-969b9f5d-0642-4919-aa78-c3721fbb351a tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:37.491612 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-969b9f5d-0642-4919-aa78-c3721fbb351a tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:37.677256 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-969b9f5d-0642-4919-aa78-c3721fbb351a tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:02:37.686942 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-969b9f5d-0642-4919-aa78-c3721fbb351a tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1522 microversion: 2.1 time: 0.218214 Jul 05 13:02:37.689245 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 95/212] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:02:37 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:02:38.711271 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-9391ac4a-5ec8-4335-b6b0-5863b4e3b6ce tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:02:38.711271 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-9391ac4a-5ec8-4335-b6b0-5863b4e3b6ce tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:02:38.715849 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-9391ac4a-5ec8-4335-b6b0-5863b4e3b6ce tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:38.716326 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-9391ac4a-5ec8-4335-b6b0-5863b4e3b6ce tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:38.717361 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-9391ac4a-5ec8-4335-b6b0-5863b4e3b6ce tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:38.717799 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-9391ac4a-5ec8-4335-b6b0-5863b4e3b6ce tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:38.864152 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-9391ac4a-5ec8-4335-b6b0-5863b4e3b6ce tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:02:38.875408 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-9391ac4a-5ec8-4335-b6b0-5863b4e3b6ce tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1522 microversion: 2.1 time: 0.172603 Jul 05 13:02:38.875995 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 118/213] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:02:38 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:02:39.897885 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-01e65bca-1037-4db0-951a-3d8b714bd0a9 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:02:39.898363 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-01e65bca-1037-4db0-951a-3d8b714bd0a9 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:02:39.904816 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_api:SELECT=39 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:39.906547 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-01e65bca-1037-4db0-951a-3d8b714bd0a9 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:39.907230 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-01e65bca-1037-4db0-951a-3d8b714bd0a9 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:39.908610 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-01e65bca-1037-4db0-951a-3d8b714bd0a9 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:39.909279 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-01e65bca-1037-4db0-951a-3d8b714bd0a9 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:40.063104 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-01e65bca-1037-4db0-951a-3d8b714bd0a9 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:02:40.070693 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-01e65bca-1037-4db0-951a-3d8b714bd0a9 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1522 microversion: 2.1 time: 0.177904 Jul 05 13:02:40.071267 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 96/214] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:02:39 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:02:41.088462 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-26b81aca-1d0f-4a98-8665-21d8964fc417 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:02:41.089712 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-26b81aca-1d0f-4a98-8665-21d8964fc417 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:02:41.097191 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-26b81aca-1d0f-4a98-8665-21d8964fc417 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:41.099576 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-26b81aca-1d0f-4a98-8665-21d8964fc417 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:41.100599 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-26b81aca-1d0f-4a98-8665-21d8964fc417 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:41.101420 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-26b81aca-1d0f-4a98-8665-21d8964fc417 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:41.247104 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-26b81aca-1d0f-4a98-8665-21d8964fc417 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:02:41.255681 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-26b81aca-1d0f-4a98-8665-21d8964fc417 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1522 microversion: 2.1 time: 0.171404 Jul 05 13:02:41.256717 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 119/215] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:02:41 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:02:42.273659 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-f57a9094-4ff7-4293-a37e-ec01ad953b0d tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:02:42.274306 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-f57a9094-4ff7-4293-a37e-ec01ad953b0d tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:02:42.281352 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f57a9094-4ff7-4293-a37e-ec01ad953b0d tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:42.281806 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f57a9094-4ff7-4293-a37e-ec01ad953b0d tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:42.282670 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f57a9094-4ff7-4293-a37e-ec01ad953b0d tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:42.283107 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f57a9094-4ff7-4293-a37e-ec01ad953b0d tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:42.423137 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-f57a9094-4ff7-4293-a37e-ec01ad953b0d tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:02:42.432506 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-f57a9094-4ff7-4293-a37e-ec01ad953b0d tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1522 microversion: 2.1 time: 0.163307 Jul 05 13:02:42.433292 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 97/216] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:02:42 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:02:43.451426 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-c9cbbe0b-29ca-4291-8c8b-ae14f540babb tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:02:43.453035 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-c9cbbe0b-29ca-4291-8c8b-ae14f540babb tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:02:43.461910 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-c9cbbe0b-29ca-4291-8c8b-ae14f540babb tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:43.462559 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-c9cbbe0b-29ca-4291-8c8b-ae14f540babb tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:43.463320 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-c9cbbe0b-29ca-4291-8c8b-ae14f540babb tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:43.463759 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-c9cbbe0b-29ca-4291-8c8b-ae14f540babb tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:43.608867 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-c9cbbe0b-29ca-4291-8c8b-ae14f540babb tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:02:43.619625 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-c9cbbe0b-29ca-4291-8c8b-ae14f540babb tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1522 microversion: 2.1 time: 0.171358 Jul 05 13:02:43.629030 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 120/217] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:02:43 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:02:44.636474 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-62a40c2f-1d8d-4d34-9a9f-aed483a3f869 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:02:44.637107 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-62a40c2f-1d8d-4d34-9a9f-aed483a3f869 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:02:44.643681 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-62a40c2f-1d8d-4d34-9a9f-aed483a3f869 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:44.644137 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-62a40c2f-1d8d-4d34-9a9f-aed483a3f869 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:44.644954 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-62a40c2f-1d8d-4d34-9a9f-aed483a3f869 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:44.645390 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-62a40c2f-1d8d-4d34-9a9f-aed483a3f869 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:44.810989 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-62a40c2f-1d8d-4d34-9a9f-aed483a3f869 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:02:44.818793 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-62a40c2f-1d8d-4d34-9a9f-aed483a3f869 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1522 microversion: 2.1 time: 0.186075 Jul 05 13:02:44.820145 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 98/218] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:02:44 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:02:45.835741 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-a138ba46-10b1-4547-a824-a8dc46121b60 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:02:45.836508 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-a138ba46-10b1-4547-a824-a8dc46121b60 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:02:45.842432 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a138ba46-10b1-4547-a824-a8dc46121b60 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:45.848822 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a138ba46-10b1-4547-a824-a8dc46121b60 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:45.848822 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a138ba46-10b1-4547-a824-a8dc46121b60 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:45.848822 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a138ba46-10b1-4547-a824-a8dc46121b60 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:45.980826 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-a138ba46-10b1-4547-a824-a8dc46121b60 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:02:45.988174 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-a138ba46-10b1-4547-a824-a8dc46121b60 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1522 microversion: 2.1 time: 0.156297 Jul 05 13:02:45.989434 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 121/219] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:02:45 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:02:47.005676 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-07640642-86b5-4586-bdf1-f3d3bf82f867 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:02:47.006225 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-07640642-86b5-4586-bdf1-f3d3bf82f867 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:02:47.012676 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-07640642-86b5-4586-bdf1-f3d3bf82f867 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:47.013128 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-07640642-86b5-4586-bdf1-f3d3bf82f867 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:47.013887 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-07640642-86b5-4586-bdf1-f3d3bf82f867 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:47.014324 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-07640642-86b5-4586-bdf1-f3d3bf82f867 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:47.149333 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-07640642-86b5-4586-bdf1-f3d3bf82f867 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:02:47.157364 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-07640642-86b5-4586-bdf1-f3d3bf82f867 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1522 microversion: 2.1 time: 0.155553 Jul 05 13:02:47.157931 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 99/220] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:02:47 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:02:48.174718 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-71615b64-241e-420c-8161-52f1719ea270 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:02:48.175335 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-71615b64-241e-420c-8161-52f1719ea270 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:02:48.182015 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-71615b64-241e-420c-8161-52f1719ea270 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:48.182461 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-71615b64-241e-420c-8161-52f1719ea270 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:48.184498 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-71615b64-241e-420c-8161-52f1719ea270 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:48.184498 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-71615b64-241e-420c-8161-52f1719ea270 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:48.317216 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-71615b64-241e-420c-8161-52f1719ea270 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:02:48.324669 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-71615b64-241e-420c-8161-52f1719ea270 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1522 microversion: 2.1 time: 0.153832 Jul 05 13:02:48.330963 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 122/221] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:02:48 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:02:49.344008 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-9a27e63e-8376-4e06-aa1f-39225fbbeac6 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:02:49.345280 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-9a27e63e-8376-4e06-aa1f-39225fbbeac6 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:02:49.354154 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9a27e63e-8376-4e06-aa1f-39225fbbeac6 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:49.354730 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9a27e63e-8376-4e06-aa1f-39225fbbeac6 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:49.355712 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9a27e63e-8376-4e06-aa1f-39225fbbeac6 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:49.356307 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9a27e63e-8376-4e06-aa1f-39225fbbeac6 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:49.502329 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-9a27e63e-8376-4e06-aa1f-39225fbbeac6 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:02:49.510335 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-9a27e63e-8376-4e06-aa1f-39225fbbeac6 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1522 microversion: 2.1 time: 0.170517 Jul 05 13:02:49.510901 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 100/222] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:02:49 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:02:50.527231 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-0e131ac8-a54d-432b-a050-bf9ab01320c1 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:02:50.527890 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-0e131ac8-a54d-432b-a050-bf9ab01320c1 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:02:50.534203 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-0e131ac8-a54d-432b-a050-bf9ab01320c1 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:50.534583 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-0e131ac8-a54d-432b-a050-bf9ab01320c1 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:50.535335 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-0e131ac8-a54d-432b-a050-bf9ab01320c1 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:50.535758 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-0e131ac8-a54d-432b-a050-bf9ab01320c1 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:50.686101 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-0e131ac8-a54d-432b-a050-bf9ab01320c1 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:02:50.694240 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-0e131ac8-a54d-432b-a050-bf9ab01320c1 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1522 microversion: 2.1 time: 0.170946 Jul 05 13:02:50.694796 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 123/223] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:02:50 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:02:51.712218 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-6568fdc8-b75a-4a4f-909d-0061ee014ede tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:02:51.713488 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-6568fdc8-b75a-4a4f-909d-0061ee014ede tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:02:51.727750 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6568fdc8-b75a-4a4f-909d-0061ee014ede tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:51.727750 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6568fdc8-b75a-4a4f-909d-0061ee014ede tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:51.727750 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6568fdc8-b75a-4a4f-909d-0061ee014ede tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:51.727750 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6568fdc8-b75a-4a4f-909d-0061ee014ede tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:51.864272 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-6568fdc8-b75a-4a4f-909d-0061ee014ede tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:02:51.871611 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-6568fdc8-b75a-4a4f-909d-0061ee014ede tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1522 microversion: 2.1 time: 0.164233 Jul 05 13:02:51.872166 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 101/224] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:02:51 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:02:52.888283 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-b96bcf86-5157-4919-8aa5-b5f19b2cfead tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:02:52.888921 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-b96bcf86-5157-4919-8aa5-b5f19b2cfead tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:02:52.895121 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b96bcf86-5157-4919-8aa5-b5f19b2cfead tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:52.895570 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b96bcf86-5157-4919-8aa5-b5f19b2cfead tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:52.896382 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b96bcf86-5157-4919-8aa5-b5f19b2cfead tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:52.896863 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b96bcf86-5157-4919-8aa5-b5f19b2cfead tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:53.023817 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-b96bcf86-5157-4919-8aa5-b5f19b2cfead tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:02:53.031731 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-b96bcf86-5157-4919-8aa5-b5f19b2cfead tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1522 microversion: 2.1 time: 0.147176 Jul 05 13:02:53.032325 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 124/225] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:02:52 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:02:54.049265 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-77964f78-9ba6-48cf-8596-6bd0183df481 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:02:54.050444 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-77964f78-9ba6-48cf-8596-6bd0183df481 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:02:54.059122 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-77964f78-9ba6-48cf-8596-6bd0183df481 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:54.063396 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-77964f78-9ba6-48cf-8596-6bd0183df481 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:54.066030 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-77964f78-9ba6-48cf-8596-6bd0183df481 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:54.066030 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-77964f78-9ba6-48cf-8596-6bd0183df481 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:54.085529 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell1:SELECT=100 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:54.295344 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-77964f78-9ba6-48cf-8596-6bd0183df481 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:02:54.311837 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-77964f78-9ba6-48cf-8596-6bd0183df481 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1502 microversion: 2.1 time: 0.266308 Jul 05 13:02:54.322053 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 102/226] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:02:54 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1502 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:02:54.331885 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-69aa3e7d-7366-41ab-ac01-3c2e3025b33c tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:02:54.332701 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-69aa3e7d-7366-41ab-ac01-3c2e3025b33c tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 2d17971e-35b1-437a-baca-1306740b41c0] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:02:54.340272 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-69aa3e7d-7366-41ab-ac01-3c2e3025b33c tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:54.341117 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-69aa3e7d-7366-41ab-ac01-3c2e3025b33c tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:54.342011 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-69aa3e7d-7366-41ab-ac01-3c2e3025b33c tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:54.342704 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-69aa3e7d-7366-41ab-ac01-3c2e3025b33c tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:54.483545 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-69aa3e7d-7366-41ab-ac01-3c2e3025b33c tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:02:54.494684 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:54.497615 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-69aa3e7d-7366-41ab-ac01-3c2e3025b33c tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0" status: 200 len: 1516 microversion: 2.1 time: 0.169903 Jul 05 13:02:54.498512 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 125/227] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:02:54 2022] GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0 => generated 1516 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:02:56.639931 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-9f145ccd-256f-4b79-8b9d-f939bf2959f1 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:02:56.640954 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-9f145ccd-256f-4b79-8b9d-f939bf2959f1 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 2d17971e-35b1-437a-baca-1306740b41c0] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:02:56.647548 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9f145ccd-256f-4b79-8b9d-f939bf2959f1 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:56.647990 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9f145ccd-256f-4b79-8b9d-f939bf2959f1 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:56.648783 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9f145ccd-256f-4b79-8b9d-f939bf2959f1 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:56.649213 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9f145ccd-256f-4b79-8b9d-f939bf2959f1 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:56.672745 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.objects.instance [None req-9f145ccd-256f-4b79-8b9d-f939bf2959f1 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lazy-loading 'flavor' on Instance uuid 2d17971e-35b1-437a-baca-1306740b41c0 {{(pid=118387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 13:02:56.993003 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-85c70854-923e-4331-b40d-b4a9081e5f7f tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:02:56.993502 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-85c70854-923e-4331-b40d-b4a9081e5f7f tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:02:57.000340 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-85c70854-923e-4331-b40d-b4a9081e5f7f tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:57.001069 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-85c70854-923e-4331-b40d-b4a9081e5f7f tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:57.004608 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-85c70854-923e-4331-b40d-b4a9081e5f7f tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:57.004608 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-85c70854-923e-4331-b40d-b4a9081e5f7f tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:57.026159 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-85c70854-923e-4331-b40d-b4a9081e5f7f tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f/ips" status: 200 len: 152 microversion: 2.20 time: 0.037789 Jul 05 13:02:57.026720 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 126/228] 10.222.0.36 () {60 vars in 1288 bytes} [Tue Jul 5 13:02:56 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f/ips => generated 152 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 05 13:02:57.094359 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-9f145ccd-256f-4b79-8b9d-f939bf2959f1 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "POST /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0/action" status: 200 len: 32 microversion: 2.1 time: 0.458351 Jul 05 13:02:57.095842 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 103/229] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Jul 5 13:02:56 2022] POST /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0/action => generated 32 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 05 13:02:57.106226 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-e8aab47f-b9b3-443d-9d9c-baa3cdd9c284 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:02:57.106754 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-e8aab47f-b9b3-443d-9d9c-baa3cdd9c284 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 2d17971e-35b1-437a-baca-1306740b41c0] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:02:57.116636 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e8aab47f-b9b3-443d-9d9c-baa3cdd9c284 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:57.117127 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e8aab47f-b9b3-443d-9d9c-baa3cdd9c284 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:57.118312 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e8aab47f-b9b3-443d-9d9c-baa3cdd9c284 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:57.118822 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e8aab47f-b9b3-443d-9d9c-baa3cdd9c284 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:57.265040 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-e8aab47f-b9b3-443d-9d9c-baa3cdd9c284 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:02:57.273223 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-e8aab47f-b9b3-443d-9d9c-baa3cdd9c284 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0" status: 200 len: 1522 microversion: 2.1 time: 0.172346 Jul 05 13:02:57.282840 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 127/230] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:02:57 2022] GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:02:57.535615 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-a86b50ae-b21f-4907-80dc-7ac900cdaf1c tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1558461779", "imageRef": "d6134305-a5c0-4d2c-afc8-e54be21f685c", "flavorRef": "452", "networks": [{"uuid": "27cb194b-43db-4891-bf2d-40d312523013"}]}} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:02:57.598313 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.network.neutron [None req-a86b50ae-b21f-4907-80dc-7ac900cdaf1c tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] validate_networks() for [('27cb194b-43db-4891-bf2d-40d312523013', None, None, None, None, None)] {{(pid=118387) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 13:02:57.975556 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-a86b50ae-b21f-4907-80dc-7ac900cdaf1c tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Flavor limits 0:0:0 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 13:02:57.976155 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-a86b50ae-b21f-4907-80dc-7ac900cdaf1c tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Image limits 0:0:0 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 13:02:57.976475 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-a86b50ae-b21f-4907-80dc-7ac900cdaf1c tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Flavor pref 0:0:0 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 13:02:57.977170 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-a86b50ae-b21f-4907-80dc-7ac900cdaf1c tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Image pref 0:0:0 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 13:02:57.977585 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-a86b50ae-b21f-4907-80dc-7ac900cdaf1c tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 13:02:57.986502 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a86b50ae-b21f-4907-80dc-7ac900cdaf1c tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:57.986949 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a86b50ae-b21f-4907-80dc-7ac900cdaf1c tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:57.987747 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a86b50ae-b21f-4907-80dc-7ac900cdaf1c tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:57.988184 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a86b50ae-b21f-4907-80dc-7ac900cdaf1c tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:58.007619 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.quota [None req-a86b50ae-b21f-4907-80dc-7ac900cdaf1c tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Getting quotas for project 380379df1d7e4ebe90c75bcefecbc787. Resources: {'instances', 'cores', 'ram'} {{(pid=118387) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 13:02:58.013643 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.quota [None req-a86b50ae-b21f-4907-80dc-7ac900cdaf1c tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Getting quotas for user e4a4bd26db664e44850f5ebccd838315 and project 380379df1d7e4ebe90c75bcefecbc787. Resources: {'instances', 'cores', 'ram'} {{(pid=118387) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 13:02:58.026010 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-a86b50ae-b21f-4907-80dc-7ac900cdaf1c tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Going to run 1 instances... {{(pid=118387) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 13:02:58.031998 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-a86b50ae-b21f-4907-80dc-7ac900cdaf1c tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] [instance: addf46fc-7cbc-4c01-a425-20630221afbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d6134305-a5c0-4d2c-afc8-e54be21f685c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118387) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 13:02:58.155766 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-a86b50ae-b21f-4907-80dc-7ac900cdaf1c tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.625560 Jul 05 13:02:58.157649 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 104/231] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jul 5 13:02:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 05 13:02:58.168728 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-1c058efb-cb5d-4612-a009-304ec3609c54 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:02:58.169884 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-1c058efb-cb5d-4612-a009-304ec3609c54 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] [instance: addf46fc-7cbc-4c01-a425-20630221afbd] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:02:58.242778 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-1c058efb-cb5d-4612-a009-304ec3609c54 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4a4bd26db664e44850f5ebccd838315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380379df1d7e4ebe90c75bcefecbc787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:02:58.250035 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-1c058efb-cb5d-4612-a009-304ec3609c54 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] 10.222.0.36 "GET /compute/v2.1/servers/addf46fc-7cbc-4c01-a425-20630221afbd" status: 200 len: 1214 microversion: 2.1 time: 0.085589 Jul 05 13:02:58.251201 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 128/232] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:02:58 2022] GET /compute/v2.1/servers/addf46fc-7cbc-4c01-a425-20630221afbd => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:02:58.294397 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-925d0fbc-38d0-4b3e-9f6d-90998e5b889e tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:02:58.294397 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-925d0fbc-38d0-4b3e-9f6d-90998e5b889e tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 2d17971e-35b1-437a-baca-1306740b41c0] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:02:58.303365 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-925d0fbc-38d0-4b3e-9f6d-90998e5b889e tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:58.303920 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-925d0fbc-38d0-4b3e-9f6d-90998e5b889e tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:58.304634 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-925d0fbc-38d0-4b3e-9f6d-90998e5b889e tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:58.305082 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-925d0fbc-38d0-4b3e-9f6d-90998e5b889e tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:58.451017 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-925d0fbc-38d0-4b3e-9f6d-90998e5b889e tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:02:58.459282 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-925d0fbc-38d0-4b3e-9f6d-90998e5b889e tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0" status: 200 len: 1522 microversion: 2.1 time: 0.171157 Jul 05 13:02:58.459860 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 105/233] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:02:58 2022] GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:02:59.267788 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-0fa36d3f-c1cb-42df-b09e-ed5f9da13fee tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:02:59.268393 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-0fa36d3f-c1cb-42df-b09e-ed5f9da13fee tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] [instance: addf46fc-7cbc-4c01-a425-20630221afbd] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:02:59.320015 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-0fa36d3f-c1cb-42df-b09e-ed5f9da13fee tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4a4bd26db664e44850f5ebccd838315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380379df1d7e4ebe90c75bcefecbc787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:02:59.327587 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-0fa36d3f-c1cb-42df-b09e-ed5f9da13fee tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] 10.222.0.36 "GET /compute/v2.1/servers/addf46fc-7cbc-4c01-a425-20630221afbd" status: 200 len: 1214 microversion: 2.1 time: 0.063560 Jul 05 13:02:59.328362 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 129/234] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:02:59 2022] GET /compute/v2.1/servers/addf46fc-7cbc-4c01-a425-20630221afbd => generated 1214 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:02:59.484164 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-7d93a764-896d-49b2-8662-041acf43c029 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:02:59.485034 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-7d93a764-896d-49b2-8662-041acf43c029 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 2d17971e-35b1-437a-baca-1306740b41c0] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:02:59.492404 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7d93a764-896d-49b2-8662-041acf43c029 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:59.493181 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7d93a764-896d-49b2-8662-041acf43c029 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:59.494034 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7d93a764-896d-49b2-8662-041acf43c029 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:02:59.494587 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7d93a764-896d-49b2-8662-041acf43c029 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:02:59.664709 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-7d93a764-896d-49b2-8662-041acf43c029 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:02:59.672642 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-7d93a764-896d-49b2-8662-041acf43c029 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0" status: 200 len: 1522 microversion: 2.1 time: 0.192832 Jul 05 13:02:59.682470 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 106/235] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:02:59 2022] GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:00.347715 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-c9ace1d0-69dc-4481-9942-5006cb086a60 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:00.348384 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-c9ace1d0-69dc-4481-9942-5006cb086a60 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] [instance: addf46fc-7cbc-4c01-a425-20630221afbd] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:00.355870 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-c9ace1d0-69dc-4481-9942-5006cb086a60 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:00.356398 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-c9ace1d0-69dc-4481-9942-5006cb086a60 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:00.357272 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-c9ace1d0-69dc-4481-9942-5006cb086a60 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:00.357769 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-c9ace1d0-69dc-4481-9942-5006cb086a60 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:00.431545 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-c9ace1d0-69dc-4481-9942-5006cb086a60 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4a4bd26db664e44850f5ebccd838315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380379df1d7e4ebe90c75bcefecbc787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:00.439624 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-c9ace1d0-69dc-4481-9942-5006cb086a60 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] 10.222.0.36 "GET /compute/v2.1/servers/addf46fc-7cbc-4c01-a425-20630221afbd" status: 200 len: 1266 microversion: 2.1 time: 0.095531 Jul 05 13:03:00.440202 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 130/236] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:00 2022] GET /compute/v2.1/servers/addf46fc-7cbc-4c01-a425-20630221afbd => generated 1266 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:00.688648 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-34b5d512-2338-474b-9da3-9aedd5bdf0ec tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:00.689846 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-34b5d512-2338-474b-9da3-9aedd5bdf0ec tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 2d17971e-35b1-437a-baca-1306740b41c0] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:00.699686 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-34b5d512-2338-474b-9da3-9aedd5bdf0ec tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:00.700139 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-34b5d512-2338-474b-9da3-9aedd5bdf0ec tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:00.700997 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-34b5d512-2338-474b-9da3-9aedd5bdf0ec tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:00.701361 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-34b5d512-2338-474b-9da3-9aedd5bdf0ec tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:00.715757 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-1e51b997-0d07-4fff-9bcd-52b9f48c47f6 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:03:00.716439 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-1e51b997-0d07-4fff-9bcd-52b9f48c47f6 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:00.722845 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-1e51b997-0d07-4fff-9bcd-52b9f48c47f6 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:00.727764 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-1e51b997-0d07-4fff-9bcd-52b9f48c47f6 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:00.727764 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-1e51b997-0d07-4fff-9bcd-52b9f48c47f6 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:00.727764 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-1e51b997-0d07-4fff-9bcd-52b9f48c47f6 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:00.750809 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.objects.instance [None req-1e51b997-0d07-4fff-9bcd-52b9f48c47f6 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lazy-loading 'flavor' on Instance uuid 72285b0b-7735-422b-b110-ef7b03fb367f {{(pid=118386) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 13:03:00.846768 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-34b5d512-2338-474b-9da3-9aedd5bdf0ec tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:00.860312 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-34b5d512-2338-474b-9da3-9aedd5bdf0ec tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0" status: 200 len: 1522 microversion: 2.1 time: 0.171124 Jul 05 13:03:00.860312 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 107/237] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:00 2022] GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:01.425772 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-1e51b997-0d07-4fff-9bcd-52b9f48c47f6 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "POST /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f/action" status: 202 len: 0 microversion: 2.20 time: 0.713889 Jul 05 13:03:01.426540 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 131/238] 10.222.0.36 () {62 vars in 1318 bytes} [Tue Jul 5 13:03:00 2022] POST /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f/action => generated 0 bytes in 716 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 05 13:03:01.435976 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-d514a4e2-bc24-4197-8d88-1c5e1552f0ea tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:01.436764 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-d514a4e2-bc24-4197-8d88-1c5e1552f0ea tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:01.444076 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d514a4e2-bc24-4197-8d88-1c5e1552f0ea tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:01.444518 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d514a4e2-bc24-4197-8d88-1c5e1552f0ea tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:01.445319 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d514a4e2-bc24-4197-8d88-1c5e1552f0ea tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:01.445747 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d514a4e2-bc24-4197-8d88-1c5e1552f0ea tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:01.466626 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-48c8e8be-c1cb-4ff1-be36-547daa555420 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:01.467427 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-48c8e8be-c1cb-4ff1-be36-547daa555420 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] [instance: addf46fc-7cbc-4c01-a425-20630221afbd] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:01.474430 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-48c8e8be-c1cb-4ff1-be36-547daa555420 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:01.474964 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-48c8e8be-c1cb-4ff1-be36-547daa555420 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:01.475882 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-48c8e8be-c1cb-4ff1-be36-547daa555420 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:01.476349 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-48c8e8be-c1cb-4ff1-be36-547daa555420 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:01.570588 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-48c8e8be-c1cb-4ff1-be36-547daa555420 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4a4bd26db664e44850f5ebccd838315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380379df1d7e4ebe90c75bcefecbc787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:01.578898 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-48c8e8be-c1cb-4ff1-be36-547daa555420 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] 10.222.0.36 "GET /compute/v2.1/servers/addf46fc-7cbc-4c01-a425-20630221afbd" status: 200 len: 1266 microversion: 2.1 time: 0.125447 Jul 05 13:03:01.579629 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 132/239] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:01 2022] GET /compute/v2.1/servers/addf46fc-7cbc-4c01-a425-20630221afbd => generated 1266 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:03:01.638458 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-d514a4e2-bc24-4197-8d88-1c5e1552f0ea tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:01.646947 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-d514a4e2-bc24-4197-8d88-1c5e1552f0ea tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:01.648501 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-d514a4e2-bc24-4197-8d88-1c5e1552f0ea tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:01.649695 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-d514a4e2-bc24-4197-8d88-1c5e1552f0ea tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1724 microversion: 2.20 time: 0.217965 Jul 05 13:03:01.650260 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 108/240] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:03:01 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1724 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:03:01.883132 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-f47d54a7-67d1-4924-84ee-1eee907f9608 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:01.883132 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-f47d54a7-67d1-4924-84ee-1eee907f9608 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 2d17971e-35b1-437a-baca-1306740b41c0] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:01.883132 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f47d54a7-67d1-4924-84ee-1eee907f9608 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:01.883512 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f47d54a7-67d1-4924-84ee-1eee907f9608 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:01.884325 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f47d54a7-67d1-4924-84ee-1eee907f9608 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:01.884744 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f47d54a7-67d1-4924-84ee-1eee907f9608 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:02.243715 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-f47d54a7-67d1-4924-84ee-1eee907f9608 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:02.251045 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-f47d54a7-67d1-4924-84ee-1eee907f9608 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0" status: 200 len: 1522 microversion: 2.1 time: 0.378732 Jul 05 13:03:02.251598 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 133/241] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:01 2022] GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0 => generated 1522 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:02.370390 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-efb57f9c-a150-4f24-9aad-2d8daa246418 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:02.370914 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-efb57f9c-a150-4f24-9aad-2d8daa246418 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 0f8f2957-1273-413b-ab2b-32da8868f70d] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:02.377350 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-efb57f9c-a150-4f24-9aad-2d8daa246418 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:02.377824 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-efb57f9c-a150-4f24-9aad-2d8daa246418 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:02.378578 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-efb57f9c-a150-4f24-9aad-2d8daa246418 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:02.379011 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-efb57f9c-a150-4f24-9aad-2d8daa246418 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:02.401696 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-efb57f9c-a150-4f24-9aad-2d8daa246418 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d/ips" status: 200 len: 150 microversion: 2.1 time: 0.035146 Jul 05 13:03:02.402253 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 109/242] 10.222.0.36 () {58 vars in 1247 bytes} [Tue Jul 5 13:03:02 2022] GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d/ips => generated 150 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:03:02.596785 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-ddcd0efc-4408-4e26-b13e-2af5a27fa2d2 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:02.597393 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-ddcd0efc-4408-4e26-b13e-2af5a27fa2d2 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] [instance: addf46fc-7cbc-4c01-a425-20630221afbd] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:02.606741 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ddcd0efc-4408-4e26-b13e-2af5a27fa2d2 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:02.606996 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ddcd0efc-4408-4e26-b13e-2af5a27fa2d2 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:02.611199 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ddcd0efc-4408-4e26-b13e-2af5a27fa2d2 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:02.611199 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ddcd0efc-4408-4e26-b13e-2af5a27fa2d2 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:02.668614 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-929fc9ce-40da-4582-a76a-7ad860754f2a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:02.669425 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-929fc9ce-40da-4582-a76a-7ad860754f2a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:02.675163 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-ddcd0efc-4408-4e26-b13e-2af5a27fa2d2 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4a4bd26db664e44850f5ebccd838315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380379df1d7e4ebe90c75bcefecbc787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:02.676134 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-929fc9ce-40da-4582-a76a-7ad860754f2a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:02.676580 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-929fc9ce-40da-4582-a76a-7ad860754f2a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:02.677491 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-929fc9ce-40da-4582-a76a-7ad860754f2a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:02.677922 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-929fc9ce-40da-4582-a76a-7ad860754f2a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:02.683306 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-ddcd0efc-4408-4e26-b13e-2af5a27fa2d2 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] 10.222.0.36 "GET /compute/v2.1/servers/addf46fc-7cbc-4c01-a425-20630221afbd" status: 200 len: 1266 microversion: 2.1 time: 0.091024 Jul 05 13:03:02.683862 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 134/243] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:02 2022] GET /compute/v2.1/servers/addf46fc-7cbc-4c01-a425-20630221afbd => generated 1266 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:02.803847 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-929fc9ce-40da-4582-a76a-7ad860754f2a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:02.811697 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-929fc9ce-40da-4582-a76a-7ad860754f2a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:02.813218 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-929fc9ce-40da-4582-a76a-7ad860754f2a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:02.814359 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-929fc9ce-40da-4582-a76a-7ad860754f2a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1724 microversion: 2.20 time: 0.149717 Jul 05 13:03:02.814904 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 110/244] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:03:02 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 13:03:03.278963 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-7ba647cb-e3ff-4d15-88e8-428159461895 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:03.278963 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-7ba647cb-e3ff-4d15-88e8-428159461895 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 2d17971e-35b1-437a-baca-1306740b41c0] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:03.282444 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-7ba647cb-e3ff-4d15-88e8-428159461895 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:03.282891 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-7ba647cb-e3ff-4d15-88e8-428159461895 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:03.286502 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-7ba647cb-e3ff-4d15-88e8-428159461895 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:03.286502 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-7ba647cb-e3ff-4d15-88e8-428159461895 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:03.437153 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-7ba647cb-e3ff-4d15-88e8-428159461895 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:03.445169 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-7ba647cb-e3ff-4d15-88e8-428159461895 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0" status: 200 len: 1522 microversion: 2.1 time: 0.176026 Jul 05 13:03:03.445750 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 135/245] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:03 2022] GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:03.699868 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-6e5e205d-6601-4d9a-9193-dc314f3b4a8f tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:03.700660 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-6e5e205d-6601-4d9a-9193-dc314f3b4a8f tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] [instance: addf46fc-7cbc-4c01-a425-20630221afbd] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:03.708227 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6e5e205d-6601-4d9a-9193-dc314f3b4a8f tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:03.708703 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6e5e205d-6601-4d9a-9193-dc314f3b4a8f tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:03.709507 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6e5e205d-6601-4d9a-9193-dc314f3b4a8f tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:03.709941 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6e5e205d-6601-4d9a-9193-dc314f3b4a8f tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:03.775729 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-6e5e205d-6601-4d9a-9193-dc314f3b4a8f tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4a4bd26db664e44850f5ebccd838315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380379df1d7e4ebe90c75bcefecbc787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:03.782608 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-6e5e205d-6601-4d9a-9193-dc314f3b4a8f tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] 10.222.0.36 "GET /compute/v2.1/servers/addf46fc-7cbc-4c01-a425-20630221afbd" status: 200 len: 1274 microversion: 2.1 time: 0.086533 Jul 05 13:03:03.783192 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 111/246] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:03 2022] GET /compute/v2.1/servers/addf46fc-7cbc-4c01-a425-20630221afbd => generated 1274 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:03.833761 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-c008328c-a189-492f-a174-197238fa2d8c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:03.835047 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-c008328c-a189-492f-a174-197238fa2d8c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:03.843644 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_api:SELECT=48 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:03:03.850524 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-c008328c-a189-492f-a174-197238fa2d8c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:03.850981 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-c008328c-a189-492f-a174-197238fa2d8c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:03.852015 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-c008328c-a189-492f-a174-197238fa2d8c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:03.852448 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-c008328c-a189-492f-a174-197238fa2d8c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:04.000428 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-c008328c-a189-492f-a174-197238fa2d8c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:04.011206 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-c008328c-a189-492f-a174-197238fa2d8c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:04.012825 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-c008328c-a189-492f-a174-197238fa2d8c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:04.014049 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-c008328c-a189-492f-a174-197238fa2d8c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1724 microversion: 2.20 time: 0.184600 Jul 05 13:03:04.014677 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 136/247] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:03:03 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:03:04.404822 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-3acfbd91-60d7-455f-84f2-e3e41acf72c5 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "40821f45-d5b7-4e86-a420-1a629ea60897"}} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:03:04.406064 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-3acfbd91-60d7-455f-84f2-e3e41acf72c5 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 0f8f2957-1273-413b-ab2b-32da8868f70d] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:04.414332 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3acfbd91-60d7-455f-84f2-e3e41acf72c5 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:04.415169 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3acfbd91-60d7-455f-84f2-e3e41acf72c5 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:04.422080 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3acfbd91-60d7-455f-84f2-e3e41acf72c5 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:04.422938 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3acfbd91-60d7-455f-84f2-e3e41acf72c5 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:04.462989 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-2d248275-2fbd-494d-a8ec-ad1fc9386340 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:04.463697 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-2d248275-2fbd-494d-a8ec-ad1fc9386340 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 2d17971e-35b1-437a-baca-1306740b41c0] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:04.472490 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-2d248275-2fbd-494d-a8ec-ad1fc9386340 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:04.473058 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-2d248275-2fbd-494d-a8ec-ad1fc9386340 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:04.473918 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-2d248275-2fbd-494d-a8ec-ad1fc9386340 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:04.474411 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-2d248275-2fbd-494d-a8ec-ad1fc9386340 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:04.623640 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-2d248275-2fbd-494d-a8ec-ad1fc9386340 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:04.626653 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-2d248275-2fbd-494d-a8ec-ad1fc9386340 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0" status: 200 len: 1522 microversion: 2.1 time: 0.168536 Jul 05 13:03:04.627219 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 137/248] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:04 2022] GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:03:04.799688 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-6cf67963-38c7-4976-8395-490b74902b52 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:04.800427 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-6cf67963-38c7-4976-8395-490b74902b52 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] [instance: addf46fc-7cbc-4c01-a425-20630221afbd] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:04.807511 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-6cf67963-38c7-4976-8395-490b74902b52 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:04.808156 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-6cf67963-38c7-4976-8395-490b74902b52 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:04.808960 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-6cf67963-38c7-4976-8395-490b74902b52 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:04.809384 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-6cf67963-38c7-4976-8395-490b74902b52 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:04.942295 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-6cf67963-38c7-4976-8395-490b74902b52 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4a4bd26db664e44850f5ebccd838315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380379df1d7e4ebe90c75bcefecbc787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:04.950326 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-6cf67963-38c7-4976-8395-490b74902b52 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] 10.222.0.36 "GET /compute/v2.1/servers/addf46fc-7cbc-4c01-a425-20630221afbd" status: 200 len: 1314 microversion: 2.1 time: 0.154762 Jul 05 13:03:04.955276 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 138/249] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:04 2022] GET /compute/v2.1/servers/addf46fc-7cbc-4c01-a425-20630221afbd => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:05.033189 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-dce89062-6b87-48f0-a135-48a2ac19f9c2 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:05.033797 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-dce89062-6b87-48f0-a135-48a2ac19f9c2 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:05.040037 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-dce89062-6b87-48f0-a135-48a2ac19f9c2 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:05.040483 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-dce89062-6b87-48f0-a135-48a2ac19f9c2 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:05.041383 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-dce89062-6b87-48f0-a135-48a2ac19f9c2 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:05.041813 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-dce89062-6b87-48f0-a135-48a2ac19f9c2 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:05.200269 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-dce89062-6b87-48f0-a135-48a2ac19f9c2 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:05.210843 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-dce89062-6b87-48f0-a135-48a2ac19f9c2 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:05.212479 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-dce89062-6b87-48f0-a135-48a2ac19f9c2 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:05.213681 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-dce89062-6b87-48f0-a135-48a2ac19f9c2 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1724 microversion: 2.20 time: 0.184401 Jul 05 13:03:05.214220 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 139/250] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:03:05 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:03:05.334732 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-3acfbd91-60d7-455f-84f2-e3e41acf72c5 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "POST /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.933250 Jul 05 13:03:05.335560 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 112/251] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Jul 5 13:03:04 2022] POST /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d/os-volume_attachments => generated 194 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:03:05.371079 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [req-f952dbfa-765c-4b4c-b6dd-4c4ccb86048e req-ba2c8d26-10ea-4735-8942-c3e657a23963 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "addf46fc-7cbc-4c01-a425-20630221afbd", "tag": "403e0b08-8730-430b-b04a-39db78b9ad8f"}]} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:03:05.381506 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-f952dbfa-765c-4b4c-b6dd-4c4ccb86048e req-ba2c8d26-10ea-4735-8942-c3e657a23963 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:05.382029 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-f952dbfa-765c-4b4c-b6dd-4c4ccb86048e req-ba2c8d26-10ea-4735-8942-c3e657a23963 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:05.408837 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.compute.server_external_events [req-f952dbfa-765c-4b4c-b6dd-4c4ccb86048e req-ba2c8d26-10ea-4735-8942-c3e657a23963 service nova] Creating event network-changed:403e0b08-8730-430b-b04a-39db78b9ad8f for instance addf46fc-7cbc-4c01-a425-20630221afbd on hv-cinder-79760 Jul 05 13:03:05.408837 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [req-f952dbfa-765c-4b4c-b6dd-4c4ccb86048e req-ba2c8d26-10ea-4735-8942-c3e657a23963 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037935 Jul 05 13:03:05.408837 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 140/252] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:03:05.646274 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-cb7961fe-c23a-415f-88f6-62fa48570a48 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:05.647634 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-cb7961fe-c23a-415f-88f6-62fa48570a48 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 2d17971e-35b1-437a-baca-1306740b41c0] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:05.656398 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cb7961fe-c23a-415f-88f6-62fa48570a48 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:05.657335 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cb7961fe-c23a-415f-88f6-62fa48570a48 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:05.662873 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cb7961fe-c23a-415f-88f6-62fa48570a48 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:05.662873 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cb7961fe-c23a-415f-88f6-62fa48570a48 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:05.814208 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-cb7961fe-c23a-415f-88f6-62fa48570a48 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:05.825084 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-cb7961fe-c23a-415f-88f6-62fa48570a48 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0" status: 200 len: 1522 microversion: 2.1 time: 0.183754 Jul 05 13:03:05.834715 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 113/253] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:05 2022] GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:05.968863 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-62d27fe6-5149-4ad8-a8d6-336db4b50113 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:05.970141 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-62d27fe6-5149-4ad8-a8d6-336db4b50113 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] [instance: addf46fc-7cbc-4c01-a425-20630221afbd] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:05.979438 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-62d27fe6-5149-4ad8-a8d6-336db4b50113 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:05.979880 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-62d27fe6-5149-4ad8-a8d6-336db4b50113 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:05.980672 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-62d27fe6-5149-4ad8-a8d6-336db4b50113 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:05.981104 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-62d27fe6-5149-4ad8-a8d6-336db4b50113 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:06.144301 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-62d27fe6-5149-4ad8-a8d6-336db4b50113 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4a4bd26db664e44850f5ebccd838315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380379df1d7e4ebe90c75bcefecbc787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:06.153768 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-62d27fe6-5149-4ad8-a8d6-336db4b50113 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] 10.222.0.36 "GET /compute/v2.1/servers/addf46fc-7cbc-4c01-a425-20630221afbd" status: 200 len: 1314 microversion: 2.1 time: 0.189008 Jul 05 13:03:06.154333 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 141/254] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:05 2022] GET /compute/v2.1/servers/addf46fc-7cbc-4c01-a425-20630221afbd => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:06.233532 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-68d60945-f699-4895-8c44-a907ffdaf83e tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:06.234422 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-68d60945-f699-4895-8c44-a907ffdaf83e tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:06.240891 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-68d60945-f699-4895-8c44-a907ffdaf83e tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:06.241534 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-68d60945-f699-4895-8c44-a907ffdaf83e tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:06.242295 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-68d60945-f699-4895-8c44-a907ffdaf83e tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:06.242773 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-68d60945-f699-4895-8c44-a907ffdaf83e tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:06.383642 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-68d60945-f699-4895-8c44-a907ffdaf83e tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:06.392397 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-68d60945-f699-4895-8c44-a907ffdaf83e tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:06.393947 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-68d60945-f699-4895-8c44-a907ffdaf83e tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:06.395131 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-68d60945-f699-4895-8c44-a907ffdaf83e tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1724 microversion: 2.20 time: 0.167431 Jul 05 13:03:06.395702 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 114/255] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:03:06 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:03:06.843403 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-df976964-0235-4e20-91ad-11c64933950d tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:06.844018 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-df976964-0235-4e20-91ad-11c64933950d tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 2d17971e-35b1-437a-baca-1306740b41c0] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:06.858588 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-df976964-0235-4e20-91ad-11c64933950d tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:06.859101 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-df976964-0235-4e20-91ad-11c64933950d tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:06.859935 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-df976964-0235-4e20-91ad-11c64933950d tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:06.860466 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-df976964-0235-4e20-91ad-11c64933950d tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:07.006960 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-df976964-0235-4e20-91ad-11c64933950d tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:07.014354 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-df976964-0235-4e20-91ad-11c64933950d tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0" status: 200 len: 1522 microversion: 2.1 time: 0.174896 Jul 05 13:03:07.014913 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 142/256] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:06 2022] GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:07.171067 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-7624d6e2-63e4-42a3-81df-42e7df439a7d tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:07.171673 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-7624d6e2-63e4-42a3-81df-42e7df439a7d tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] [instance: addf46fc-7cbc-4c01-a425-20630221afbd] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:07.178343 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7624d6e2-63e4-42a3-81df-42e7df439a7d tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:07.182580 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7624d6e2-63e4-42a3-81df-42e7df439a7d tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:07.182580 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7624d6e2-63e4-42a3-81df-42e7df439a7d tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:07.182580 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7624d6e2-63e4-42a3-81df-42e7df439a7d tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:07.354990 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-7624d6e2-63e4-42a3-81df-42e7df439a7d tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4a4bd26db664e44850f5ebccd838315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380379df1d7e4ebe90c75bcefecbc787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:07.362658 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-7624d6e2-63e4-42a3-81df-42e7df439a7d tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] 10.222.0.36 "GET /compute/v2.1/servers/addf46fc-7cbc-4c01-a425-20630221afbd" status: 200 len: 1314 microversion: 2.1 time: 0.195782 Jul 05 13:03:07.363258 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 115/257] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:07 2022] GET /compute/v2.1/servers/addf46fc-7cbc-4c01-a425-20630221afbd => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:07.413472 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-3118deef-d9ab-41a1-be0f-505b9d5600c5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:07.414078 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-3118deef-d9ab-41a1-be0f-505b9d5600c5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:07.420133 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-3118deef-d9ab-41a1-be0f-505b9d5600c5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:07.420575 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-3118deef-d9ab-41a1-be0f-505b9d5600c5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:07.421360 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-3118deef-d9ab-41a1-be0f-505b9d5600c5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:07.421786 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-3118deef-d9ab-41a1-be0f-505b9d5600c5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:07.578871 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:03:07.705324 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-3118deef-d9ab-41a1-be0f-505b9d5600c5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:07.713893 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-3118deef-d9ab-41a1-be0f-505b9d5600c5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:07.715581 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-3118deef-d9ab-41a1-be0f-505b9d5600c5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:07.716860 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-3118deef-d9ab-41a1-be0f-505b9d5600c5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1724 microversion: 2.20 time: 0.307725 Jul 05 13:03:07.720563 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 143/258] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:03:07 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1724 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:03:08.034151 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-89fe32f4-c39d-45dc-b49c-75da3f3d898f tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:08.034850 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-89fe32f4-c39d-45dc-b49c-75da3f3d898f tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 2d17971e-35b1-437a-baca-1306740b41c0] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:08.037042 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell0:SELECT=2 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:03:08.038325 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell0:SELECT=6 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:03:08.043732 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-89fe32f4-c39d-45dc-b49c-75da3f3d898f tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:08.044264 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-89fe32f4-c39d-45dc-b49c-75da3f3d898f tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:08.045169 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-89fe32f4-c39d-45dc-b49c-75da3f3d898f tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:08.045678 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-89fe32f4-c39d-45dc-b49c-75da3f3d898f tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:08.199286 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-89fe32f4-c39d-45dc-b49c-75da3f3d898f tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:08.201750 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:03:08.210462 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-89fe32f4-c39d-45dc-b49c-75da3f3d898f tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0" status: 200 len: 1522 microversion: 2.1 time: 0.180632 Jul 05 13:03:08.210462 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 116/259] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:08 2022] GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:08.379969 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-8e33734c-6e17-4936-bf16-6ecad9daaa1e tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:08.381217 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-8e33734c-6e17-4936-bf16-6ecad9daaa1e tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] [instance: addf46fc-7cbc-4c01-a425-20630221afbd] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:08.390826 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-8e33734c-6e17-4936-bf16-6ecad9daaa1e tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:08.391266 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-8e33734c-6e17-4936-bf16-6ecad9daaa1e tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:08.392024 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-8e33734c-6e17-4936-bf16-6ecad9daaa1e tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:08.392450 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-8e33734c-6e17-4936-bf16-6ecad9daaa1e tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:08.524700 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-8e33734c-6e17-4936-bf16-6ecad9daaa1e tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4a4bd26db664e44850f5ebccd838315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380379df1d7e4ebe90c75bcefecbc787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:08.532612 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-8e33734c-6e17-4936-bf16-6ecad9daaa1e tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] 10.222.0.36 "GET /compute/v2.1/servers/addf46fc-7cbc-4c01-a425-20630221afbd" status: 200 len: 1314 microversion: 2.1 time: 0.156981 Jul 05 13:03:08.533118 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 144/260] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:08 2022] GET /compute/v2.1/servers/addf46fc-7cbc-4c01-a425-20630221afbd => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:08.735516 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-ecd32540-5ef9-44df-9355-b06a60fb1b79 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:08.736134 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-ecd32540-5ef9-44df-9355-b06a60fb1b79 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:08.743716 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ecd32540-5ef9-44df-9355-b06a60fb1b79 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:08.744220 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ecd32540-5ef9-44df-9355-b06a60fb1b79 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:08.745116 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ecd32540-5ef9-44df-9355-b06a60fb1b79 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:08.745564 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ecd32540-5ef9-44df-9355-b06a60fb1b79 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:08.882921 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-ecd32540-5ef9-44df-9355-b06a60fb1b79 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:08.890838 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-ecd32540-5ef9-44df-9355-b06a60fb1b79 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:08.892336 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-ecd32540-5ef9-44df-9355-b06a60fb1b79 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:08.893551 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-ecd32540-5ef9-44df-9355-b06a60fb1b79 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1724 microversion: 2.20 time: 0.162273 Jul 05 13:03:08.904834 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 117/261] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:03:08 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:03:09.225736 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-a773f50f-53b7-4fe0-9405-c0b5c3545358 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:09.226348 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-a773f50f-53b7-4fe0-9405-c0b5c3545358 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 2d17971e-35b1-437a-baca-1306740b41c0] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:09.232945 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a773f50f-53b7-4fe0-9405-c0b5c3545358 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:09.233703 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a773f50f-53b7-4fe0-9405-c0b5c3545358 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:09.235294 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a773f50f-53b7-4fe0-9405-c0b5c3545358 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:09.235794 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a773f50f-53b7-4fe0-9405-c0b5c3545358 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:09.324124 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_cell0:SELECT=4 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:03:09.377101 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-a773f50f-53b7-4fe0-9405-c0b5c3545358 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:09.385121 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-a773f50f-53b7-4fe0-9405-c0b5c3545358 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0" status: 200 len: 1522 microversion: 2.1 time: 0.163152 Jul 05 13:03:09.385706 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 145/262] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:09 2022] GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:09.549546 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-4d9441b0-06b1-4b60-87ec-96addd62be58 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:09.550927 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-4d9441b0-06b1-4b60-87ec-96addd62be58 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] [instance: addf46fc-7cbc-4c01-a425-20630221afbd] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:09.559508 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4d9441b0-06b1-4b60-87ec-96addd62be58 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:09.560144 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4d9441b0-06b1-4b60-87ec-96addd62be58 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:09.566969 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4d9441b0-06b1-4b60-87ec-96addd62be58 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:09.567661 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4d9441b0-06b1-4b60-87ec-96addd62be58 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:09.915212 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-42797b6a-6ab0-4fdc-bda6-796341d6664e tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:09.916167 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-42797b6a-6ab0-4fdc-bda6-796341d6664e tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:09.922786 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-42797b6a-6ab0-4fdc-bda6-796341d6664e tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:09.923438 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-42797b6a-6ab0-4fdc-bda6-796341d6664e tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:09.924482 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-42797b6a-6ab0-4fdc-bda6-796341d6664e tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:09.925366 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-42797b6a-6ab0-4fdc-bda6-796341d6664e tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:10.014287 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-4d9441b0-06b1-4b60-87ec-96addd62be58 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4a4bd26db664e44850f5ebccd838315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380379df1d7e4ebe90c75bcefecbc787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:10.022824 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-4d9441b0-06b1-4b60-87ec-96addd62be58 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] 10.222.0.36 "GET /compute/v2.1/servers/addf46fc-7cbc-4c01-a425-20630221afbd" status: 200 len: 1314 microversion: 2.1 time: 0.477354 Jul 05 13:03:10.023532 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 118/263] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:09 2022] GET /compute/v2.1/servers/addf46fc-7cbc-4c01-a425-20630221afbd => generated 1314 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:10.113314 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-42797b6a-6ab0-4fdc-bda6-796341d6664e tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:10.122377 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-42797b6a-6ab0-4fdc-bda6-796341d6664e tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:10.123878 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-42797b6a-6ab0-4fdc-bda6-796341d6664e tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:10.125208 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-42797b6a-6ab0-4fdc-bda6-796341d6664e tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1724 microversion: 2.20 time: 0.216407 Jul 05 13:03:10.125775 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 146/264] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:03:09 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1724 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:03:10.402893 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-b04c64c6-ce1b-45b3-bb0d-aa9da40bf858 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:10.403509 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-b04c64c6-ce1b-45b3-bb0d-aa9da40bf858 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 2d17971e-35b1-437a-baca-1306740b41c0] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:10.409489 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b04c64c6-ce1b-45b3-bb0d-aa9da40bf858 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:10.409941 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b04c64c6-ce1b-45b3-bb0d-aa9da40bf858 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:10.410703 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b04c64c6-ce1b-45b3-bb0d-aa9da40bf858 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:10.411142 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b04c64c6-ce1b-45b3-bb0d-aa9da40bf858 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:10.564749 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-b04c64c6-ce1b-45b3-bb0d-aa9da40bf858 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:10.572198 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-b04c64c6-ce1b-45b3-bb0d-aa9da40bf858 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0" status: 200 len: 1522 microversion: 2.1 time: 0.173180 Jul 05 13:03:10.572946 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 119/265] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:10 2022] GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:11.039278 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-6f4098e1-b9e7-4c98-b445-5be4e1c790f3 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:11.039896 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-6f4098e1-b9e7-4c98-b445-5be4e1c790f3 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] [instance: addf46fc-7cbc-4c01-a425-20630221afbd] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:11.046300 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-6f4098e1-b9e7-4c98-b445-5be4e1c790f3 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:11.046754 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-6f4098e1-b9e7-4c98-b445-5be4e1c790f3 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:11.047530 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-6f4098e1-b9e7-4c98-b445-5be4e1c790f3 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:11.047968 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-6f4098e1-b9e7-4c98-b445-5be4e1c790f3 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:11.145511 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-7c25cf0e-e11a-4e5f-af52-66a8856ef2b2 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:11.146505 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-7c25cf0e-e11a-4e5f-af52-66a8856ef2b2 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:11.153987 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7c25cf0e-e11a-4e5f-af52-66a8856ef2b2 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:11.154444 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7c25cf0e-e11a-4e5f-af52-66a8856ef2b2 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:11.155254 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7c25cf0e-e11a-4e5f-af52-66a8856ef2b2 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:11.155931 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7c25cf0e-e11a-4e5f-af52-66a8856ef2b2 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:11.188490 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-6f4098e1-b9e7-4c98-b445-5be4e1c790f3 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4a4bd26db664e44850f5ebccd838315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380379df1d7e4ebe90c75bcefecbc787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:11.196752 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-6f4098e1-b9e7-4c98-b445-5be4e1c790f3 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] 10.222.0.36 "GET /compute/v2.1/servers/addf46fc-7cbc-4c01-a425-20630221afbd" status: 200 len: 1314 microversion: 2.1 time: 0.161243 Jul 05 13:03:11.197316 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 147/266] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:11 2022] GET /compute/v2.1/servers/addf46fc-7cbc-4c01-a425-20630221afbd => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:11.284446 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-7c25cf0e-e11a-4e5f-af52-66a8856ef2b2 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:11.292537 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-7c25cf0e-e11a-4e5f-af52-66a8856ef2b2 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:11.294063 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-7c25cf0e-e11a-4e5f-af52-66a8856ef2b2 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:11.295221 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-7c25cf0e-e11a-4e5f-af52-66a8856ef2b2 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1724 microversion: 2.20 time: 0.155995 Jul 05 13:03:11.295767 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 120/267] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:03:11 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 13:03:11.589522 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-a798cb6a-4ebb-44a9-ab69-f7435a4cbc22 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:11.590120 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-a798cb6a-4ebb-44a9-ab69-f7435a4cbc22 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 2d17971e-35b1-437a-baca-1306740b41c0] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:11.596248 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a798cb6a-4ebb-44a9-ab69-f7435a4cbc22 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:11.596727 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a798cb6a-4ebb-44a9-ab69-f7435a4cbc22 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:11.597484 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a798cb6a-4ebb-44a9-ab69-f7435a4cbc22 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:11.600087 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a798cb6a-4ebb-44a9-ab69-f7435a4cbc22 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:11.738796 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-a798cb6a-4ebb-44a9-ab69-f7435a4cbc22 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:11.747234 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-a798cb6a-4ebb-44a9-ab69-f7435a4cbc22 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0" status: 200 len: 1522 microversion: 2.1 time: 0.161219 Jul 05 13:03:11.747789 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 148/268] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:11 2022] GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:12.217367 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-58f4d024-57b0-4e39-bda6-b687118f1613 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:12.218080 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-58f4d024-57b0-4e39-bda6-b687118f1613 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] [instance: addf46fc-7cbc-4c01-a425-20630221afbd] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:12.226604 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-58f4d024-57b0-4e39-bda6-b687118f1613 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:12.227293 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-58f4d024-57b0-4e39-bda6-b687118f1613 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:12.228266 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-58f4d024-57b0-4e39-bda6-b687118f1613 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:12.234697 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-58f4d024-57b0-4e39-bda6-b687118f1613 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:12.313792 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-676e41e7-48af-4029-a060-3ffa574ce736 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:12.314887 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-676e41e7-48af-4029-a060-3ffa574ce736 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:12.322224 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-676e41e7-48af-4029-a060-3ffa574ce736 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:12.322661 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-676e41e7-48af-4029-a060-3ffa574ce736 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:12.323626 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-676e41e7-48af-4029-a060-3ffa574ce736 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:12.324046 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-676e41e7-48af-4029-a060-3ffa574ce736 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:12.393274 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-58f4d024-57b0-4e39-bda6-b687118f1613 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4a4bd26db664e44850f5ebccd838315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380379df1d7e4ebe90c75bcefecbc787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:12.401296 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-58f4d024-57b0-4e39-bda6-b687118f1613 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] 10.222.0.36 "GET /compute/v2.1/servers/addf46fc-7cbc-4c01-a425-20630221afbd" status: 200 len: 1314 microversion: 2.1 time: 0.189875 Jul 05 13:03:12.402517 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 121/269] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:12 2022] GET /compute/v2.1/servers/addf46fc-7cbc-4c01-a425-20630221afbd => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:12.407632 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-1be2d2d7-2282-4521-bf32-dbd86dd045c6 req-ecaa6bfe-a935-4e00-9d43-e1352e6a1e0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "addf46fc-7cbc-4c01-a425-20630221afbd", "name": "network-vif-plugged", "status": "completed", "tag": "403e0b08-8730-430b-b04a-39db78b9ad8f"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:03:12.411533 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:03:12.418308 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-1be2d2d7-2282-4521-bf32-dbd86dd045c6 req-ecaa6bfe-a935-4e00-9d43-e1352e6a1e0a service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:12.419030 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-1be2d2d7-2282-4521-bf32-dbd86dd045c6 req-ecaa6bfe-a935-4e00-9d43-e1352e6a1e0a service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:12.440189 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-1be2d2d7-2282-4521-bf32-dbd86dd045c6 req-ecaa6bfe-a935-4e00-9d43-e1352e6a1e0a service nova] Creating event network-vif-plugged:403e0b08-8730-430b-b04a-39db78b9ad8f for instance addf46fc-7cbc-4c01-a425-20630221afbd on hv-cinder-79760 Jul 05 13:03:12.471111 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-1be2d2d7-2282-4521-bf32-dbd86dd045c6 req-ecaa6bfe-a935-4e00-9d43-e1352e6a1e0a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066850 Jul 05 13:03:12.473648 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 122/270] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:03:12.499003 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-676e41e7-48af-4029-a060-3ffa574ce736 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:12.508285 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-676e41e7-48af-4029-a060-3ffa574ce736 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:12.510320 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-676e41e7-48af-4029-a060-3ffa574ce736 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:12.512695 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-676e41e7-48af-4029-a060-3ffa574ce736 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1724 microversion: 2.20 time: 0.202969 Jul 05 13:03:12.514141 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 149/271] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:03:12 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 13:03:12.764699 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-b0d3be68-e4e2-4277-af34-2da6b7f2ca3b tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:12.765394 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-b0d3be68-e4e2-4277-af34-2da6b7f2ca3b tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 2d17971e-35b1-437a-baca-1306740b41c0] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:12.772260 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b0d3be68-e4e2-4277-af34-2da6b7f2ca3b tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:12.772727 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b0d3be68-e4e2-4277-af34-2da6b7f2ca3b tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:12.773513 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b0d3be68-e4e2-4277-af34-2da6b7f2ca3b tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:12.773941 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b0d3be68-e4e2-4277-af34-2da6b7f2ca3b tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:12.906270 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-b0d3be68-e4e2-4277-af34-2da6b7f2ca3b tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:12.914960 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-b0d3be68-e4e2-4277-af34-2da6b7f2ca3b tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0" status: 200 len: 1522 microversion: 2.1 time: 0.155165 Jul 05 13:03:12.915662 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 123/272] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:12 2022] GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:13.480496 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-5a74a1b6-3079-4a06-9e3e-217404f775c3 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:13.481202 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-5a74a1b6-3079-4a06-9e3e-217404f775c3 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] [instance: addf46fc-7cbc-4c01-a425-20630221afbd] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:13.488182 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-5a74a1b6-3079-4a06-9e3e-217404f775c3 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:13.488775 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-5a74a1b6-3079-4a06-9e3e-217404f775c3 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:13.489773 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-5a74a1b6-3079-4a06-9e3e-217404f775c3 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:13.490311 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-5a74a1b6-3079-4a06-9e3e-217404f775c3 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:13.533462 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-ac8ad55d-a13d-4bb7-b90a-3d2ad608447a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:13.534239 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-ac8ad55d-a13d-4bb7-b90a-3d2ad608447a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:13.548294 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ac8ad55d-a13d-4bb7-b90a-3d2ad608447a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:13.551014 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ac8ad55d-a13d-4bb7-b90a-3d2ad608447a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:13.555802 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ac8ad55d-a13d-4bb7-b90a-3d2ad608447a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:13.555802 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ac8ad55d-a13d-4bb7-b90a-3d2ad608447a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:13.675232 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-5a74a1b6-3079-4a06-9e3e-217404f775c3 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4a4bd26db664e44850f5ebccd838315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380379df1d7e4ebe90c75bcefecbc787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:13.682703 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-5a74a1b6-3079-4a06-9e3e-217404f775c3 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] 10.222.0.36 "GET /compute/v2.1/servers/addf46fc-7cbc-4c01-a425-20630221afbd" status: 200 len: 1314 microversion: 2.1 time: 0.206541 Jul 05 13:03:13.683294 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 150/273] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:13 2022] GET /compute/v2.1/servers/addf46fc-7cbc-4c01-a425-20630221afbd => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:13.743646 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-ac8ad55d-a13d-4bb7-b90a-3d2ad608447a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:13.752104 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-ac8ad55d-a13d-4bb7-b90a-3d2ad608447a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:13.753650 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-ac8ad55d-a13d-4bb7-b90a-3d2ad608447a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:13.755038 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-ac8ad55d-a13d-4bb7-b90a-3d2ad608447a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1724 microversion: 2.20 time: 0.227858 Jul 05 13:03:13.756324 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 124/274] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:03:13 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1724 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:03:13.936523 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-e0689f3a-3719-4213-8d6b-497346787aff tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:13.944710 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-e0689f3a-3719-4213-8d6b-497346787aff tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 2d17971e-35b1-437a-baca-1306740b41c0] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:13.953259 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e0689f3a-3719-4213-8d6b-497346787aff tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:13.953790 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e0689f3a-3719-4213-8d6b-497346787aff tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:13.954638 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e0689f3a-3719-4213-8d6b-497346787aff tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:13.955141 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e0689f3a-3719-4213-8d6b-497346787aff tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:14.236159 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-e0689f3a-3719-4213-8d6b-497346787aff tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:14.246066 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-e0689f3a-3719-4213-8d6b-497346787aff tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0" status: 200 len: 1522 microversion: 2.1 time: 0.317826 Jul 05 13:03:14.246733 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 151/275] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:13 2022] GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0 => generated 1522 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:14.700724 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-37383f28-c439-4837-adb1-f9436eb6be7d tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:14.701369 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-37383f28-c439-4837-adb1-f9436eb6be7d tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] [instance: addf46fc-7cbc-4c01-a425-20630221afbd] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:14.708551 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-37383f28-c439-4837-adb1-f9436eb6be7d tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:14.709367 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-37383f28-c439-4837-adb1-f9436eb6be7d tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:14.710095 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-37383f28-c439-4837-adb1-f9436eb6be7d tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:14.710537 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-37383f28-c439-4837-adb1-f9436eb6be7d tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:14.781329 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-704bc9a2-8f14-406d-9735-0f5469395464 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:14.785732 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-704bc9a2-8f14-406d-9735-0f5469395464 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:14.790022 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-704bc9a2-8f14-406d-9735-0f5469395464 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:14.799029 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-704bc9a2-8f14-406d-9735-0f5469395464 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:14.800114 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-704bc9a2-8f14-406d-9735-0f5469395464 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:14.800944 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-704bc9a2-8f14-406d-9735-0f5469395464 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:14.970028 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-37383f28-c439-4837-adb1-f9436eb6be7d tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4a4bd26db664e44850f5ebccd838315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380379df1d7e4ebe90c75bcefecbc787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:14.980558 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-37383f28-c439-4837-adb1-f9436eb6be7d tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] 10.222.0.36 "GET /compute/v2.1/servers/addf46fc-7cbc-4c01-a425-20630221afbd" status: 200 len: 1314 microversion: 2.1 time: 0.285041 Jul 05 13:03:14.981156 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 125/276] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:14 2022] GET /compute/v2.1/servers/addf46fc-7cbc-4c01-a425-20630221afbd => generated 1314 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:15.007322 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-704bc9a2-8f14-406d-9735-0f5469395464 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:15.019460 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-704bc9a2-8f14-406d-9735-0f5469395464 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:15.021873 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-704bc9a2-8f14-406d-9735-0f5469395464 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:15.023486 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-704bc9a2-8f14-406d-9735-0f5469395464 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1724 microversion: 2.20 time: 0.249160 Jul 05 13:03:15.024153 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 152/277] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:03:14 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1724 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 13:03:15.268330 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-885a2de2-672a-455b-bceb-f670e240ad55 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:15.268330 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-885a2de2-672a-455b-bceb-f670e240ad55 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 2d17971e-35b1-437a-baca-1306740b41c0] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:15.275197 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-885a2de2-672a-455b-bceb-f670e240ad55 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:15.276489 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-885a2de2-672a-455b-bceb-f670e240ad55 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:15.277621 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-885a2de2-672a-455b-bceb-f670e240ad55 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:15.278162 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-885a2de2-672a-455b-bceb-f670e240ad55 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:15.434722 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-885a2de2-672a-455b-bceb-f670e240ad55 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:15.444856 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-885a2de2-672a-455b-bceb-f670e240ad55 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0" status: 200 len: 1522 microversion: 2.1 time: 0.184043 Jul 05 13:03:15.450081 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 126/278] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:15 2022] GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:15.997420 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-4b7dfa51-48fa-4423-9cb9-0a09ae98aec3 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:15.998028 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-4b7dfa51-48fa-4423-9cb9-0a09ae98aec3 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] [instance: addf46fc-7cbc-4c01-a425-20630221afbd] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:16.004322 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-4b7dfa51-48fa-4423-9cb9-0a09ae98aec3 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:16.005000 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-4b7dfa51-48fa-4423-9cb9-0a09ae98aec3 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:16.005982 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-4b7dfa51-48fa-4423-9cb9-0a09ae98aec3 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:16.006442 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-4b7dfa51-48fa-4423-9cb9-0a09ae98aec3 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:16.042361 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-e494e2f9-84d1-4370-b378-e80c409f28bd tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:16.042972 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-e494e2f9-84d1-4370-b378-e80c409f28bd tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:16.065646 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e494e2f9-84d1-4370-b378-e80c409f28bd tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:16.066042 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e494e2f9-84d1-4370-b378-e80c409f28bd tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:16.066841 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e494e2f9-84d1-4370-b378-e80c409f28bd tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:16.067394 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e494e2f9-84d1-4370-b378-e80c409f28bd tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:16.427506 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-4b7dfa51-48fa-4423-9cb9-0a09ae98aec3 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4a4bd26db664e44850f5ebccd838315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380379df1d7e4ebe90c75bcefecbc787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:16.431863 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-e494e2f9-84d1-4370-b378-e80c409f28bd tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:16.443811 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-e494e2f9-84d1-4370-b378-e80c409f28bd tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:16.445141 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-4b7dfa51-48fa-4423-9cb9-0a09ae98aec3 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] 10.222.0.36 "GET /compute/v2.1/servers/addf46fc-7cbc-4c01-a425-20630221afbd" status: 200 len: 1314 microversion: 2.1 time: 0.451663 Jul 05 13:03:16.447089 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-e494e2f9-84d1-4370-b378-e80c409f28bd tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:16.448938 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-e494e2f9-84d1-4370-b378-e80c409f28bd tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1724 microversion: 2.20 time: 0.410257 Jul 05 13:03:16.452298 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 127/279] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:03:16 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1724 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 13:03:16.458188 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 153/280] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:15 2022] GET /compute/v2.1/servers/addf46fc-7cbc-4c01-a425-20630221afbd => generated 1314 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:16.463993 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-38663430-e586-4fee-821e-323e47433b83 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Action: 'create', calling method: .version_select at 0x7f70de8ec700>, body: {"keypair": {"name": "tempest-keypair-1087570709", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCRHpSysUFQyilZdKEKjQyJw6vPID9R8G0MxVFrMbzMCzF/e/AihuyZpnrmgNNPFJgQuBA7k1W8GrE3LnyngfH0/n6EeK6Gg6jSWs1i4+Gu0F+A7aESndNqGsEWSLf3t6g=="}} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:03:16.472203 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-187b28b0-ea31-4272-8b2f-a5bc7a9f98f0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:16.475234 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-187b28b0-ea31-4272-8b2f-a5bc7a9f98f0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 2d17971e-35b1-437a-baca-1306740b41c0] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:16.480572 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-187b28b0-ea31-4272-8b2f-a5bc7a9f98f0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:16.481278 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-187b28b0-ea31-4272-8b2f-a5bc7a9f98f0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:16.482240 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-187b28b0-ea31-4272-8b2f-a5bc7a9f98f0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:16.482872 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-187b28b0-ea31-4272-8b2f-a5bc7a9f98f0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:16.487849 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.quota [None req-38663430-e586-4fee-821e-323e47433b83 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Getting quotas for project 163f0d5f47be49f493296f228d1080a5. Resources: {'key_pairs'} {{(pid=118387) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 13:03:16.495717 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.quota [None req-38663430-e586-4fee-821e-323e47433b83 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Getting quotas for user aa97e27060b3429bbad061a256db19f1 and project 163f0d5f47be49f493296f228d1080a5. Resources: {'key_pairs'} {{(pid=118387) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 13:03:16.613061 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-38663430-e586-4fee-821e-323e47433b83 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.157042 Jul 05 13:03:16.613061 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 128/281] 10.222.0.36 () {60 vars in 1158 bytes} [Tue Jul 5 13:03:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:03:16.682970 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-187b28b0-ea31-4272-8b2f-a5bc7a9f98f0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:16.690590 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-187b28b0-ea31-4272-8b2f-a5bc7a9f98f0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0" status: 200 len: 1522 microversion: 2.1 time: 0.230742 Jul 05 13:03:16.691657 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 154/282] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:16 2022] GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0 => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:17.485022 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-be7a007b-f058-41be-8292-a8a23c6fab2e tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:17.488348 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-be7a007b-f058-41be-8292-a8a23c6fab2e tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:17.495790 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-f01491d9-aeeb-47d6-a0b9-251c021f0db4 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:17.496425 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-f01491d9-aeeb-47d6-a0b9-251c021f0db4 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] [instance: addf46fc-7cbc-4c01-a425-20630221afbd] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:17.501572 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-be7a007b-f058-41be-8292-a8a23c6fab2e tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:17.513725 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-be7a007b-f058-41be-8292-a8a23c6fab2e tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:17.514101 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-be7a007b-f058-41be-8292-a8a23c6fab2e tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:17.514690 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f01491d9-aeeb-47d6-a0b9-251c021f0db4 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:17.515348 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-be7a007b-f058-41be-8292-a8a23c6fab2e tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:17.515965 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f01491d9-aeeb-47d6-a0b9-251c021f0db4 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:17.519726 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f01491d9-aeeb-47d6-a0b9-251c021f0db4 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:17.520619 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f01491d9-aeeb-47d6-a0b9-251c021f0db4 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:17.884416 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-f01491d9-aeeb-47d6-a0b9-251c021f0db4 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4a4bd26db664e44850f5ebccd838315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380379df1d7e4ebe90c75bcefecbc787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:17.889308 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-be7a007b-f058-41be-8292-a8a23c6fab2e tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:17.899748 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-be7a007b-f058-41be-8292-a8a23c6fab2e tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:17.902229 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-f01491d9-aeeb-47d6-a0b9-251c021f0db4 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] 10.222.0.36 "GET /compute/v2.1/servers/addf46fc-7cbc-4c01-a425-20630221afbd" status: 200 len: 1314 microversion: 2.1 time: 0.429600 Jul 05 13:03:17.902820 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 129/283] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:17 2022] GET /compute/v2.1/servers/addf46fc-7cbc-4c01-a425-20630221afbd => generated 1314 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:17.905677 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-be7a007b-f058-41be-8292-a8a23c6fab2e tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:17.907098 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-be7a007b-f058-41be-8292-a8a23c6fab2e tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1724 microversion: 2.20 time: 0.427408 Jul 05 13:03:17.907726 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 155/284] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:03:17 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1724 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:03:17.910214 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-ea7efd7a-f06a-459c-bfcd-a3063906b506 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:17.910980 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-ea7efd7a-f06a-459c-bfcd-a3063906b506 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 2d17971e-35b1-437a-baca-1306740b41c0] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:17.929804 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ea7efd7a-f06a-459c-bfcd-a3063906b506 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:17.930676 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ea7efd7a-f06a-459c-bfcd-a3063906b506 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:17.931652 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ea7efd7a-f06a-459c-bfcd-a3063906b506 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:17.932459 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ea7efd7a-f06a-459c-bfcd-a3063906b506 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:18.212627 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-ea7efd7a-f06a-459c-bfcd-a3063906b506 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:18.220961 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-ea7efd7a-f06a-459c-bfcd-a3063906b506 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0" status: 200 len: 1522 microversion: 2.1 time: 0.316403 Jul 05 13:03:18.221543 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 130/285] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:17 2022] GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0 => generated 1522 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:18.919306 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-8a820e57-57fa-4480-bd6e-feaed8f60f8c tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:18.919850 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-8a820e57-57fa-4480-bd6e-feaed8f60f8c tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] [instance: addf46fc-7cbc-4c01-a425-20630221afbd] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:18.926154 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-8a820e57-57fa-4480-bd6e-feaed8f60f8c tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:18.926823 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-8a820e57-57fa-4480-bd6e-feaed8f60f8c tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:18.927805 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-8a820e57-57fa-4480-bd6e-feaed8f60f8c tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:18.928455 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-8a820e57-57fa-4480-bd6e-feaed8f60f8c tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:18.931089 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-51e77ba3-31bd-4aa4-87aa-1cda1a2a87c5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:18.931703 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-51e77ba3-31bd-4aa4-87aa-1cda1a2a87c5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:18.938430 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-51e77ba3-31bd-4aa4-87aa-1cda1a2a87c5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:18.938873 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-51e77ba3-31bd-4aa4-87aa-1cda1a2a87c5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:18.939726 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-51e77ba3-31bd-4aa4-87aa-1cda1a2a87c5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:18.940157 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-51e77ba3-31bd-4aa4-87aa-1cda1a2a87c5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:19.405334 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-8a820e57-57fa-4480-bd6e-feaed8f60f8c tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4a4bd26db664e44850f5ebccd838315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380379df1d7e4ebe90c75bcefecbc787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:19.413447 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-8a820e57-57fa-4480-bd6e-feaed8f60f8c tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] 10.222.0.36 "GET /compute/v2.1/servers/addf46fc-7cbc-4c01-a425-20630221afbd" status: 200 len: 1314 microversion: 2.1 time: 0.498075 Jul 05 13:03:19.417696 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 156/286] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:18 2022] GET /compute/v2.1/servers/addf46fc-7cbc-4c01-a425-20630221afbd => generated 1314 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:19.422806 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-c2a6c074-b85a-48bf-bfcd-45a221d9c07d tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:19.424788 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-c2a6c074-b85a-48bf-bfcd-45a221d9c07d tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 2d17971e-35b1-437a-baca-1306740b41c0] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:19.439796 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-c2a6c074-b85a-48bf-bfcd-45a221d9c07d tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:19.440248 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-c2a6c074-b85a-48bf-bfcd-45a221d9c07d tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:19.441051 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-c2a6c074-b85a-48bf-bfcd-45a221d9c07d tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:19.441524 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-c2a6c074-b85a-48bf-bfcd-45a221d9c07d tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:19.454146 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-51e77ba3-31bd-4aa4-87aa-1cda1a2a87c5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:19.462801 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-51e77ba3-31bd-4aa4-87aa-1cda1a2a87c5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:19.464244 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-51e77ba3-31bd-4aa4-87aa-1cda1a2a87c5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:19.465465 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-51e77ba3-31bd-4aa4-87aa-1cda1a2a87c5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1724 microversion: 2.20 time: 0.539420 Jul 05 13:03:19.466013 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 131/287] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:03:18 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1724 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 13:03:19.625359 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-c2a6c074-b85a-48bf-bfcd-45a221d9c07d tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:19.635533 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-c2a6c074-b85a-48bf-bfcd-45a221d9c07d tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0" status: 200 len: 1522 microversion: 2.1 time: 0.216541 Jul 05 13:03:19.646133 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 157/288] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:19 2022] GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0 => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:19.663069 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-febe46b5-7586-4676-a8d0-18666d213dc9 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-408068926", "imageRef": "d6134305-a5c0-4d2c-afc8-e54be21f685c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3aaa0da9-0f6f-4fc6-8a51-4d7d6726eda8"}], "security_groups": [{"name": "tempest-securitygroup--1076532720"}], "key_name": "tempest-keypair-1087570709", "user_data": "}} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:03:19.782065 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.network.neutron [None req-febe46b5-7586-4676-a8d0-18666d213dc9 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] validate_networks() for [('3aaa0da9-0f6f-4fc6-8a51-4d7d6726eda8', None, None, None, None, None)] {{(pid=118387) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 13:03:20.179424 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-febe46b5-7586-4676-a8d0-18666d213dc9 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Flavor limits 0:0:0 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 13:03:20.180979 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-febe46b5-7586-4676-a8d0-18666d213dc9 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Image limits 0:0:0 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 13:03:20.181632 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-febe46b5-7586-4676-a8d0-18666d213dc9 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Flavor pref 0:0:0 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 13:03:20.182203 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-febe46b5-7586-4676-a8d0-18666d213dc9 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Image pref 0:0:0 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 13:03:20.182769 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-febe46b5-7586-4676-a8d0-18666d213dc9 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 13:03:20.198773 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-febe46b5-7586-4676-a8d0-18666d213dc9 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:20.199216 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-febe46b5-7586-4676-a8d0-18666d213dc9 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:20.201122 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-febe46b5-7586-4676-a8d0-18666d213dc9 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:20.201122 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-febe46b5-7586-4676-a8d0-18666d213dc9 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:20.221032 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.quota [None req-febe46b5-7586-4676-a8d0-18666d213dc9 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Getting quotas for project 163f0d5f47be49f493296f228d1080a5. Resources: {'instances', 'cores', 'ram'} {{(pid=118387) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 13:03:20.226108 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.quota [None req-febe46b5-7586-4676-a8d0-18666d213dc9 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Getting quotas for user aa97e27060b3429bbad061a256db19f1 and project 163f0d5f47be49f493296f228d1080a5. Resources: {'instances', 'cores', 'ram'} {{(pid=118387) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 13:03:20.245465 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-febe46b5-7586-4676-a8d0-18666d213dc9 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Going to run 1 instances... {{(pid=118387) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 13:03:20.248189 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-febe46b5-7586-4676-a8d0-18666d213dc9 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: fce1b2d5-4167-4f64-9ea2-794a86830bd2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d6134305-a5c0-4d2c-afc8-e54be21f685c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118387) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 13:03:20.411846 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-febe46b5-7586-4676-a8d0-18666d213dc9 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.753394 Jul 05 13:03:20.413169 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 132/289] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jul 5 13:03:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 05 13:03:20.425210 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-3746fbb6-4ef3-4add-adb4-1280e2a5b5e7 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:20.425974 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-3746fbb6-4ef3-4add-adb4-1280e2a5b5e7 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: fce1b2d5-4167-4f64-9ea2-794a86830bd2] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:20.432265 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-b28e54dc-cde7-4ebf-a953-181fe9d3da7f tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:20.436318 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-b28e54dc-cde7-4ebf-a953-181fe9d3da7f tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] [instance: addf46fc-7cbc-4c01-a425-20630221afbd] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:20.461348 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b28e54dc-cde7-4ebf-a953-181fe9d3da7f tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:20.461815 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b28e54dc-cde7-4ebf-a953-181fe9d3da7f tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:20.462617 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b28e54dc-cde7-4ebf-a953-181fe9d3da7f tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:20.463056 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b28e54dc-cde7-4ebf-a953-181fe9d3da7f tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:20.551859 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-3746fbb6-4ef3-4add-adb4-1280e2a5b5e7 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:20.560861 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-3746fbb6-4ef3-4add-adb4-1280e2a5b5e7 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2" status: 200 len: 1241 microversion: 2.1 time: 0.138284 Jul 05 13:03:20.563444 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 158/290] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:20 2022] GET /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2 => generated 1241 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:20.574454 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-05b695da-ec37-44f6-b891-0198433c326d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:20.575395 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-05b695da-ec37-44f6-b891-0198433c326d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:20.582717 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-05b695da-ec37-44f6-b891-0198433c326d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:20.584720 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-05b695da-ec37-44f6-b891-0198433c326d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:20.585721 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-05b695da-ec37-44f6-b891-0198433c326d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:20.586866 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-05b695da-ec37-44f6-b891-0198433c326d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:20.786585 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-05b695da-ec37-44f6-b891-0198433c326d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:20.794046 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-b28e54dc-cde7-4ebf-a953-181fe9d3da7f tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4a4bd26db664e44850f5ebccd838315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380379df1d7e4ebe90c75bcefecbc787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:20.795140 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-05b695da-ec37-44f6-b891-0198433c326d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:20.796648 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-05b695da-ec37-44f6-b891-0198433c326d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:20.797797 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-05b695da-ec37-44f6-b891-0198433c326d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1724 microversion: 2.20 time: 0.231986 Jul 05 13:03:20.800133 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 159/291] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:03:20 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1724 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:03:20.803275 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-b28e54dc-cde7-4ebf-a953-181fe9d3da7f tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] 10.222.0.36 "GET /compute/v2.1/servers/addf46fc-7cbc-4c01-a425-20630221afbd" status: 200 len: 1314 microversion: 2.1 time: 0.376036 Jul 05 13:03:20.803998 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 133/292] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:20 2022] GET /compute/v2.1/servers/addf46fc-7cbc-4c01-a425-20630221afbd => generated 1314 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:03:20.804119 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-1f90eba9-d508-4d1e-83f7-1efd085548fb tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:20.804687 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-1f90eba9-d508-4d1e-83f7-1efd085548fb tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 2d17971e-35b1-437a-baca-1306740b41c0] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:20.810894 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-1f90eba9-d508-4d1e-83f7-1efd085548fb tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:20.811512 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-1f90eba9-d508-4d1e-83f7-1efd085548fb tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:20.812316 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-1f90eba9-d508-4d1e-83f7-1efd085548fb tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:20.812764 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-1f90eba9-d508-4d1e-83f7-1efd085548fb tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:21.010104 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-1f90eba9-d508-4d1e-83f7-1efd085548fb tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:21.019363 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-1f90eba9-d508-4d1e-83f7-1efd085548fb tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0" status: 200 len: 1522 microversion: 2.1 time: 0.219548 Jul 05 13:03:21.026317 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 160/293] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:20 2022] GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0 => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:21.580006 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-865cd9f9-feb8-4079-ba5f-e03153bbb7b8 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:21.581177 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-865cd9f9-feb8-4079-ba5f-e03153bbb7b8 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: fce1b2d5-4167-4f64-9ea2-794a86830bd2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:21.588112 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-865cd9f9-feb8-4079-ba5f-e03153bbb7b8 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:21.589257 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-865cd9f9-feb8-4079-ba5f-e03153bbb7b8 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:21.594908 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-865cd9f9-feb8-4079-ba5f-e03153bbb7b8 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:21.594908 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-865cd9f9-feb8-4079-ba5f-e03153bbb7b8 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:21.666950 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-865cd9f9-feb8-4079-ba5f-e03153bbb7b8 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:21.675400 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-865cd9f9-feb8-4079-ba5f-e03153bbb7b8 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2" status: 200 len: 1245 microversion: 2.1 time: 0.100624 Jul 05 13:03:21.676107 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 134/294] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:21 2022] GET /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2 => generated 1245 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:21.819185 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-4e0169db-728d-425a-aa00-0916957fc938 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:21.819780 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-8e035d82-e350-417b-b1c9-a73fc96eeb48 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:21.819960 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-8e035d82-e350-417b-b1c9-a73fc96eeb48 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] [instance: addf46fc-7cbc-4c01-a425-20630221afbd] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:21.820911 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-4e0169db-728d-425a-aa00-0916957fc938 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:21.829205 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-4e0169db-728d-425a-aa00-0916957fc938 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:21.830211 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-4e0169db-728d-425a-aa00-0916957fc938 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:21.831366 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-4e0169db-728d-425a-aa00-0916957fc938 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:21.832009 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-4e0169db-728d-425a-aa00-0916957fc938 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:21.838576 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_cell1:SELECT=100 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:03:21.841942 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8e035d82-e350-417b-b1c9-a73fc96eeb48 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:21.845903 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8e035d82-e350-417b-b1c9-a73fc96eeb48 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:21.848000 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8e035d82-e350-417b-b1c9-a73fc96eeb48 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:21.848622 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8e035d82-e350-417b-b1c9-a73fc96eeb48 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:22.161993 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-8e035d82-e350-417b-b1c9-a73fc96eeb48 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4a4bd26db664e44850f5ebccd838315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380379df1d7e4ebe90c75bcefecbc787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:22.165418 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell1:SELECT=100 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:03:22.173439 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-8e035d82-e350-417b-b1c9-a73fc96eeb48 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] 10.222.0.36 "GET /compute/v2.1/servers/addf46fc-7cbc-4c01-a425-20630221afbd" status: 200 len: 1314 microversion: 2.1 time: 0.357842 Jul 05 13:03:22.176214 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 135/295] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:21 2022] GET /compute/v2.1/servers/addf46fc-7cbc-4c01-a425-20630221afbd => generated 1314 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:03:22.187365 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-99186651-dd7a-415c-8c8c-c871022b03ef tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:22.188376 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-99186651-dd7a-415c-8c8c-c871022b03ef tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 2d17971e-35b1-437a-baca-1306740b41c0] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:22.197876 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-99186651-dd7a-415c-8c8c-c871022b03ef tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:22.198652 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-99186651-dd7a-415c-8c8c-c871022b03ef tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:22.202591 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-99186651-dd7a-415c-8c8c-c871022b03ef tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:22.203314 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-99186651-dd7a-415c-8c8c-c871022b03ef tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:22.226702 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-4e0169db-728d-425a-aa00-0916957fc938 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:22.242160 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-4e0169db-728d-425a-aa00-0916957fc938 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:22.244826 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-4e0169db-728d-425a-aa00-0916957fc938 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:22.249379 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-4e0169db-728d-425a-aa00-0916957fc938 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1724 microversion: 2.20 time: 0.434301 Jul 05 13:03:22.249946 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 161/296] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:03:21 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1724 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:03:22.504864 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-99186651-dd7a-415c-8c8c-c871022b03ef tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:22.513964 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-99186651-dd7a-415c-8c8c-c871022b03ef tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0" status: 200 len: 1522 microversion: 2.1 time: 0.333087 Jul 05 13:03:22.514674 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 136/297] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:22 2022] GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0 => generated 1522 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:22.696995 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-2b6fe2ec-35b9-4510-848f-9e1e7e168a5f tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:22.697931 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-2b6fe2ec-35b9-4510-848f-9e1e7e168a5f tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: fce1b2d5-4167-4f64-9ea2-794a86830bd2] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:22.704993 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-2b6fe2ec-35b9-4510-848f-9e1e7e168a5f tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:22.705437 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-2b6fe2ec-35b9-4510-848f-9e1e7e168a5f tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:22.706221 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-2b6fe2ec-35b9-4510-848f-9e1e7e168a5f tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:22.706690 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-2b6fe2ec-35b9-4510-848f-9e1e7e168a5f tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:22.781210 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-2b6fe2ec-35b9-4510-848f-9e1e7e168a5f tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:22.789758 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-2b6fe2ec-35b9-4510-848f-9e1e7e168a5f tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2" status: 200 len: 1245 microversion: 2.1 time: 0.099198 Jul 05 13:03:22.790324 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 162/298] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:22 2022] GET /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2 => generated 1245 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:23.192182 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-aa7e1a20-4f87-4426-991c-d660c141ac95 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:23.196684 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-aa7e1a20-4f87-4426-991c-d660c141ac95 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] [instance: addf46fc-7cbc-4c01-a425-20630221afbd] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:23.201223 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-aa7e1a20-4f87-4426-991c-d660c141ac95 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:23.201683 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-aa7e1a20-4f87-4426-991c-d660c141ac95 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:23.202472 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-aa7e1a20-4f87-4426-991c-d660c141ac95 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:23.203306 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-aa7e1a20-4f87-4426-991c-d660c141ac95 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:23.268890 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-61ee9a09-aa1a-4025-9b2b-3f12060eebae tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:23.269706 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-61ee9a09-aa1a-4025-9b2b-3f12060eebae tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:23.276763 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-61ee9a09-aa1a-4025-9b2b-3f12060eebae tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:23.277652 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-61ee9a09-aa1a-4025-9b2b-3f12060eebae tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:23.278646 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-61ee9a09-aa1a-4025-9b2b-3f12060eebae tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:23.279164 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-61ee9a09-aa1a-4025-9b2b-3f12060eebae tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:23.533471 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-aa7e1a20-4f87-4426-991c-d660c141ac95 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4a4bd26db664e44850f5ebccd838315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380379df1d7e4ebe90c75bcefecbc787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:23.542373 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-aa7e1a20-4f87-4426-991c-d660c141ac95 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] 10.222.0.36 "GET /compute/v2.1/servers/addf46fc-7cbc-4c01-a425-20630221afbd" status: 200 len: 1499 microversion: 2.1 time: 0.354035 Jul 05 13:03:23.548636 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 137/299] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:23 2022] GET /compute/v2.1/servers/addf46fc-7cbc-4c01-a425-20630221afbd => generated 1499 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:23.548827 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-c9383c20-8eb9-4f57-a16e-51b1a5fbe51c tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:23.549392 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-c9383c20-8eb9-4f57-a16e-51b1a5fbe51c tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 2d17971e-35b1-437a-baca-1306740b41c0] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:23.561243 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c9383c20-8eb9-4f57-a16e-51b1a5fbe51c tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:23.561896 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c9383c20-8eb9-4f57-a16e-51b1a5fbe51c tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:23.562677 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c9383c20-8eb9-4f57-a16e-51b1a5fbe51c tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:23.563267 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c9383c20-8eb9-4f57-a16e-51b1a5fbe51c tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:23.573089 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-61ee9a09-aa1a-4025-9b2b-3f12060eebae tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:23.587278 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-61ee9a09-aa1a-4025-9b2b-3f12060eebae tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:23.590381 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-61ee9a09-aa1a-4025-9b2b-3f12060eebae tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:23.593961 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-61ee9a09-aa1a-4025-9b2b-3f12060eebae tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1724 microversion: 2.20 time: 0.328611 Jul 05 13:03:23.605160 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 163/300] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:03:23 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1724 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 13:03:23.807701 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-47fa2b96-c3b4-494f-8b4b-4bbe2003a9b9 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:23.808306 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-47fa2b96-c3b4-494f-8b4b-4bbe2003a9b9 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: fce1b2d5-4167-4f64-9ea2-794a86830bd2] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:23.814665 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-47fa2b96-c3b4-494f-8b4b-4bbe2003a9b9 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:23.815325 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-47fa2b96-c3b4-494f-8b4b-4bbe2003a9b9 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:23.816309 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-47fa2b96-c3b4-494f-8b4b-4bbe2003a9b9 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:23.816796 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-47fa2b96-c3b4-494f-8b4b-4bbe2003a9b9 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:23.829270 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-c9383c20-8eb9-4f57-a16e-51b1a5fbe51c tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:23.839836 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-c9383c20-8eb9-4f57-a16e-51b1a5fbe51c tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0" status: 200 len: 1522 microversion: 2.1 time: 0.295875 Jul 05 13:03:23.840556 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 138/301] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:23 2022] GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0 => generated 1522 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:23.888903 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-47fa2b96-c3b4-494f-8b4b-4bbe2003a9b9 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:23.896537 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-47fa2b96-c3b4-494f-8b4b-4bbe2003a9b9 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2" status: 200 len: 1245 microversion: 2.1 time: 0.092500 Jul 05 13:03:23.897128 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 164/302] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:23 2022] GET /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2 => generated 1245 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:24.612984 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-81563326-a3f2-48e8-860e-9b34ce15f2df tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:24.613790 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-81563326-a3f2-48e8-860e-9b34ce15f2df tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:24.620341 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-81563326-a3f2-48e8-860e-9b34ce15f2df tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:24.622260 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-81563326-a3f2-48e8-860e-9b34ce15f2df tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:24.630216 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-81563326-a3f2-48e8-860e-9b34ce15f2df tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:24.630216 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-81563326-a3f2-48e8-860e-9b34ce15f2df tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:24.848369 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-81563326-a3f2-48e8-860e-9b34ce15f2df tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:24.863609 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-612ba95f-8bc7-48dd-8b70-fa90ff379393 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:24.864809 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-612ba95f-8bc7-48dd-8b70-fa90ff379393 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 2d17971e-35b1-437a-baca-1306740b41c0] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:24.871412 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-81563326-a3f2-48e8-860e-9b34ce15f2df tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:24.876613 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-81563326-a3f2-48e8-860e-9b34ce15f2df tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:24.877624 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-612ba95f-8bc7-48dd-8b70-fa90ff379393 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:24.878846 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-612ba95f-8bc7-48dd-8b70-fa90ff379393 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:24.879394 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-81563326-a3f2-48e8-860e-9b34ce15f2df tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1724 microversion: 2.20 time: 0.270036 Jul 05 13:03:24.881165 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 139/303] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:03:24 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1724 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:03:24.889806 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-612ba95f-8bc7-48dd-8b70-fa90ff379393 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:24.890299 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-612ba95f-8bc7-48dd-8b70-fa90ff379393 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:24.916572 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-8921efc2-1208-47c2-8167-b6520dbdc063 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:24.918704 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-8921efc2-1208-47c2-8167-b6520dbdc063 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: fce1b2d5-4167-4f64-9ea2-794a86830bd2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:24.928165 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8921efc2-1208-47c2-8167-b6520dbdc063 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:24.928683 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8921efc2-1208-47c2-8167-b6520dbdc063 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:24.929455 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8921efc2-1208-47c2-8167-b6520dbdc063 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:24.929951 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8921efc2-1208-47c2-8167-b6520dbdc063 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:25.057204 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-8921efc2-1208-47c2-8167-b6520dbdc063 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:25.067220 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-8921efc2-1208-47c2-8167-b6520dbdc063 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2" status: 200 len: 1245 microversion: 2.1 time: 0.156686 Jul 05 13:03:25.077159 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 140/304] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:24 2022] GET /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2 => generated 1245 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:03:25.168190 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-612ba95f-8bc7-48dd-8b70-fa90ff379393 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:25.178631 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-612ba95f-8bc7-48dd-8b70-fa90ff379393 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0" status: 200 len: 1522 microversion: 2.1 time: 0.323440 Jul 05 13:03:25.189161 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 165/305] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:24 2022] GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0 => generated 1522 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:25.902680 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-32555594-c8bf-42e6-9dc6-b0df3f10d56e tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:25.903685 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-32555594-c8bf-42e6-9dc6-b0df3f10d56e tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:25.917985 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-32555594-c8bf-42e6-9dc6-b0df3f10d56e tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:25.918588 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-32555594-c8bf-42e6-9dc6-b0df3f10d56e tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:25.919401 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-32555594-c8bf-42e6-9dc6-b0df3f10d56e tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:25.920084 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-32555594-c8bf-42e6-9dc6-b0df3f10d56e tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:26.084700 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-0d7bf469-4aec-42ae-a223-3f0811fdcada tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:26.085694 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-0d7bf469-4aec-42ae-a223-3f0811fdcada tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: fce1b2d5-4167-4f64-9ea2-794a86830bd2] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:26.092348 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-0d7bf469-4aec-42ae-a223-3f0811fdcada tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:26.093134 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-0d7bf469-4aec-42ae-a223-3f0811fdcada tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:26.094248 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-0d7bf469-4aec-42ae-a223-3f0811fdcada tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:26.094662 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-0d7bf469-4aec-42ae-a223-3f0811fdcada tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:26.184108 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-0d7bf469-4aec-42ae-a223-3f0811fdcada tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:26.203155 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-0d7bf469-4aec-42ae-a223-3f0811fdcada tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2" status: 200 len: 1245 microversion: 2.1 time: 0.122632 Jul 05 13:03:26.204383 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 166/306] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:26 2022] GET /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2 => generated 1245 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:26.209838 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-433d74d7-bd24-4926-84f8-8c9e9f33751d tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:26.210733 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-433d74d7-bd24-4926-84f8-8c9e9f33751d tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 2d17971e-35b1-437a-baca-1306740b41c0] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:26.217105 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-433d74d7-bd24-4926-84f8-8c9e9f33751d tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:26.217552 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-433d74d7-bd24-4926-84f8-8c9e9f33751d tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:26.218331 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-433d74d7-bd24-4926-84f8-8c9e9f33751d tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:26.218759 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-433d74d7-bd24-4926-84f8-8c9e9f33751d tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:26.269535 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-32555594-c8bf-42e6-9dc6-b0df3f10d56e tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:26.291808 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-32555594-c8bf-42e6-9dc6-b0df3f10d56e tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:26.293684 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-32555594-c8bf-42e6-9dc6-b0df3f10d56e tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:26.298297 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-32555594-c8bf-42e6-9dc6-b0df3f10d56e tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1724 microversion: 2.20 time: 0.396566 Jul 05 13:03:26.298937 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 141/307] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:03:25 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1724 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 13:03:26.475541 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-433d74d7-bd24-4926-84f8-8c9e9f33751d tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:26.484863 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-433d74d7-bd24-4926-84f8-8c9e9f33751d tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0" status: 200 len: 1522 microversion: 2.1 time: 0.279025 Jul 05 13:03:26.485915 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 167/308] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:26 2022] GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0 => generated 1522 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:26.995500 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-cf4d4151-7a8d-4844-aeda-6299d3c39eb1 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Action: 'create', calling method: .version_select at 0x7f70de71b160>, body: {"keypair": {"name": "tempest-TestShelveInstance-162669083", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJRgkzbyQAbD6BowuW9/9hOkoYwdv5mR07iZd7LNIhFNwgCCAeFitLMc0tj9nTpHXPKXI7LrWpkZap14PXmNyVTYbazDepxhnN88gfBtk9dQnwi6m8RfXtGzULrR/u9gzg=="}} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:03:27.010997 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.quota [None req-cf4d4151-7a8d-4844-aeda-6299d3c39eb1 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Getting quotas for project ec699c3dd1ab470c8cc0685e6e9f766a. Resources: {'key_pairs'} {{(pid=118387) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 13:03:27.015276 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.quota [None req-cf4d4151-7a8d-4844-aeda-6299d3c39eb1 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Getting quotas for user 4cf000835f1f48cca0a46b233e52c8b9 and project ec699c3dd1ab470c8cc0685e6e9f766a. Resources: {'key_pairs'} {{(pid=118387) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 13:03:27.095741 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-cf4d4151-7a8d-4844-aeda-6299d3c39eb1 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.317736 Jul 05 13:03:27.096445 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 142/309] 10.222.0.36 () {60 vars in 1158 bytes} [Tue Jul 5 13:03:26 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:03:27.223518 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-e14b919f-6547-44ad-a0e0-debf23cdeabb tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:27.225065 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-e14b919f-6547-44ad-a0e0-debf23cdeabb tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: fce1b2d5-4167-4f64-9ea2-794a86830bd2] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:27.232080 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e14b919f-6547-44ad-a0e0-debf23cdeabb tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:27.232680 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e14b919f-6547-44ad-a0e0-debf23cdeabb tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:27.233717 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e14b919f-6547-44ad-a0e0-debf23cdeabb tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:27.234340 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e14b919f-6547-44ad-a0e0-debf23cdeabb tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:27.294402 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-e14b919f-6547-44ad-a0e0-debf23cdeabb tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:27.301783 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-e14b919f-6547-44ad-a0e0-debf23cdeabb tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2" status: 200 len: 1245 microversion: 2.1 time: 0.085579 Jul 05 13:03:27.302338 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 168/310] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:27 2022] GET /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2 => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:27.316634 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-2e7ddc00-402f-405f-a949-10aafeeb2d7e tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:27.317770 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-2e7ddc00-402f-405f-a949-10aafeeb2d7e tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:27.324598 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2e7ddc00-402f-405f-a949-10aafeeb2d7e tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:27.325059 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2e7ddc00-402f-405f-a949-10aafeeb2d7e tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:27.325820 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2e7ddc00-402f-405f-a949-10aafeeb2d7e tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:27.326252 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2e7ddc00-402f-405f-a949-10aafeeb2d7e tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:27.461892 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-2e7ddc00-402f-405f-a949-10aafeeb2d7e tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:27.469859 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-2e7ddc00-402f-405f-a949-10aafeeb2d7e tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:27.471353 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-2e7ddc00-402f-405f-a949-10aafeeb2d7e tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:27.472502 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-2e7ddc00-402f-405f-a949-10aafeeb2d7e tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1724 microversion: 2.20 time: 0.160152 Jul 05 13:03:27.473078 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 143/311] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:03:27 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 13:03:27.511752 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-00d6bd6a-5caf-4633-9345-ea70e3db2e31 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:27.512362 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-00d6bd6a-5caf-4633-9345-ea70e3db2e31 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 2d17971e-35b1-437a-baca-1306740b41c0] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:27.518559 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-00d6bd6a-5caf-4633-9345-ea70e3db2e31 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:27.519019 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-00d6bd6a-5caf-4633-9345-ea70e3db2e31 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:27.519758 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-00d6bd6a-5caf-4633-9345-ea70e3db2e31 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:27.520191 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-00d6bd6a-5caf-4633-9345-ea70e3db2e31 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:27.651339 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-00d6bd6a-5caf-4633-9345-ea70e3db2e31 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:27.661269 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-00d6bd6a-5caf-4633-9345-ea70e3db2e31 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0" status: 200 len: 1522 microversion: 2.1 time: 0.153273 Jul 05 13:03:27.661832 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 169/312] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:27 2022] GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:28.319207 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-f330de83-db3c-4c17-84f8-b67006fcc225 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:28.320063 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-f330de83-db3c-4c17-84f8-b67006fcc225 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: fce1b2d5-4167-4f64-9ea2-794a86830bd2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:28.326762 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f330de83-db3c-4c17-84f8-b67006fcc225 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:28.327216 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f330de83-db3c-4c17-84f8-b67006fcc225 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:28.327972 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f330de83-db3c-4c17-84f8-b67006fcc225 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:28.328401 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f330de83-db3c-4c17-84f8-b67006fcc225 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:28.392522 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-f330de83-db3c-4c17-84f8-b67006fcc225 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:28.403603 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-f330de83-db3c-4c17-84f8-b67006fcc225 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2" status: 200 len: 1245 microversion: 2.1 time: 0.088928 Jul 05 13:03:28.409062 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 144/313] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:28 2022] GET /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2 => generated 1245 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:28.491498 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-d056e276-41f2-4359-ab5b-c6868452759b tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:28.492301 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-d056e276-41f2-4359-ab5b-c6868452759b tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:28.499018 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-d056e276-41f2-4359-ab5b-c6868452759b tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:28.499742 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-d056e276-41f2-4359-ab5b-c6868452759b tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:28.500610 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-d056e276-41f2-4359-ab5b-c6868452759b tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:28.501189 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-d056e276-41f2-4359-ab5b-c6868452759b tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:28.650363 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-d056e276-41f2-4359-ab5b-c6868452759b tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:28.658100 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-d056e276-41f2-4359-ab5b-c6868452759b tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:28.659614 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-d056e276-41f2-4359-ab5b-c6868452759b tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:28.661577 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-d056e276-41f2-4359-ab5b-c6868452759b tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1724 microversion: 2.20 time: 0.174407 Jul 05 13:03:28.662156 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 170/314] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:03:28 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:03:28.677510 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-23db4b1a-9183-404e-ad46-d19968996e7b tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:28.678190 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-23db4b1a-9183-404e-ad46-d19968996e7b tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 2d17971e-35b1-437a-baca-1306740b41c0] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:28.684203 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-23db4b1a-9183-404e-ad46-d19968996e7b tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:28.684684 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-23db4b1a-9183-404e-ad46-d19968996e7b tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:28.685452 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-23db4b1a-9183-404e-ad46-d19968996e7b tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:28.685920 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-23db4b1a-9183-404e-ad46-d19968996e7b tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:28.828903 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-23db4b1a-9183-404e-ad46-d19968996e7b tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:28.836965 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-23db4b1a-9183-404e-ad46-d19968996e7b tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0" status: 200 len: 1522 microversion: 2.1 time: 0.163316 Jul 05 13:03:28.837541 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 145/315] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:28 2022] GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:29.422058 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-12518d91-e7ad-4ea1-9936-45e94f3f6f4d tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:29.422697 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-12518d91-e7ad-4ea1-9936-45e94f3f6f4d tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: fce1b2d5-4167-4f64-9ea2-794a86830bd2] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:29.445750 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-12518d91-e7ad-4ea1-9936-45e94f3f6f4d tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:29.445750 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-12518d91-e7ad-4ea1-9936-45e94f3f6f4d tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:29.445750 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-12518d91-e7ad-4ea1-9936-45e94f3f6f4d tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:29.445750 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-12518d91-e7ad-4ea1-9936-45e94f3f6f4d tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:29.534761 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-12518d91-e7ad-4ea1-9936-45e94f3f6f4d tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:29.543775 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-12518d91-e7ad-4ea1-9936-45e94f3f6f4d tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2" status: 200 len: 1245 microversion: 2.1 time: 0.125696 Jul 05 13:03:29.545033 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 171/316] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:29 2022] GET /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2 => generated 1245 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:29.683751 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-fdfe87d8-9465-4baa-94db-1b6537972e95 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:29.685093 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-fdfe87d8-9465-4baa-94db-1b6537972e95 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:29.695577 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-fdfe87d8-9465-4baa-94db-1b6537972e95 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:29.697277 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-fdfe87d8-9465-4baa-94db-1b6537972e95 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:29.702598 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-fdfe87d8-9465-4baa-94db-1b6537972e95 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:29.702598 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-fdfe87d8-9465-4baa-94db-1b6537972e95 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:29.855111 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-d3cd80d7-0b32-4794-b39a-a069ac8f303d tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:29.855889 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-d3cd80d7-0b32-4794-b39a-a069ac8f303d tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 2d17971e-35b1-437a-baca-1306740b41c0] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:29.868142 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-d3cd80d7-0b32-4794-b39a-a069ac8f303d tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:29.868612 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-d3cd80d7-0b32-4794-b39a-a069ac8f303d tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:29.869405 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-d3cd80d7-0b32-4794-b39a-a069ac8f303d tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:29.869948 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-d3cd80d7-0b32-4794-b39a-a069ac8f303d tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:29.924944 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-fdfe87d8-9465-4baa-94db-1b6537972e95 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:29.937847 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-fdfe87d8-9465-4baa-94db-1b6537972e95 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:29.941088 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-fdfe87d8-9465-4baa-94db-1b6537972e95 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:29.942565 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-fdfe87d8-9465-4baa-94db-1b6537972e95 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1724 microversion: 2.20 time: 0.265584 Jul 05 13:03:29.943576 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 146/317] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:03:29 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1724 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:03:30.009576 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-863638e6-2929-4182-ab09-42fd9ab5f949 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:30.010072 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-863638e6-2929-4182-ab09-42fd9ab5f949 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] [instance: addf46fc-7cbc-4c01-a425-20630221afbd] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:30.034465 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-863638e6-2929-4182-ab09-42fd9ab5f949 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:30.034916 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-863638e6-2929-4182-ab09-42fd9ab5f949 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:30.039649 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-863638e6-2929-4182-ab09-42fd9ab5f949 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:30.044794 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-863638e6-2929-4182-ab09-42fd9ab5f949 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:30.119793 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-863638e6-2929-4182-ab09-42fd9ab5f949 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] [instance: addf46fc-7cbc-4c01-a425-20630221afbd] Going to try to terminate instance {{(pid=118387) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 13:03:30.211095 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell0:SELECT=2 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:03:30.261359 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-d3cd80d7-0b32-4794-b39a-a069ac8f303d tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:30.284230 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-d3cd80d7-0b32-4794-b39a-a069ac8f303d tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0" status: 200 len: 1522 microversion: 2.1 time: 0.433692 Jul 05 13:03:30.287186 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 172/318] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:29 2022] GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0 => generated 1522 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:03:30.535476 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-863638e6-2929-4182-ab09-42fd9ab5f949 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] 10.222.0.36 "DELETE /compute/v2.1/servers/addf46fc-7cbc-4c01-a425-20630221afbd" status: 204 len: 0 microversion: 2.1 time: 0.531093 Jul 05 13:03:30.536224 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 147/319] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jul 5 13:03:30 2022] DELETE /compute/v2.1/servers/addf46fc-7cbc-4c01-a425-20630221afbd => generated 0 bytes in 533 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 05 13:03:30.544875 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-a56fff35-1729-41d3-96b3-523d47a91273 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:30.547243 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-a56fff35-1729-41d3-96b3-523d47a91273 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] [instance: addf46fc-7cbc-4c01-a425-20630221afbd] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:30.552181 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a56fff35-1729-41d3-96b3-523d47a91273 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:30.552637 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a56fff35-1729-41d3-96b3-523d47a91273 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:30.553403 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a56fff35-1729-41d3-96b3-523d47a91273 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:30.553839 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a56fff35-1729-41d3-96b3-523d47a91273 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:30.559544 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_cell0:SELECT=2 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:03:30.564912 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-bd85209a-e554-4201-be92-5fe526af59bb tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:30.565389 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-bd85209a-e554-4201-be92-5fe526af59bb tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: fce1b2d5-4167-4f64-9ea2-794a86830bd2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:30.572579 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-bd85209a-e554-4201-be92-5fe526af59bb tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:30.573167 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-bd85209a-e554-4201-be92-5fe526af59bb tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:30.574055 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-bd85209a-e554-4201-be92-5fe526af59bb tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:30.574564 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-bd85209a-e554-4201-be92-5fe526af59bb tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:30.670817 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-bd85209a-e554-4201-be92-5fe526af59bb tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:30.681514 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-bd85209a-e554-4201-be92-5fe526af59bb tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2" status: 200 len: 1293 microversion: 2.1 time: 0.123542 Jul 05 13:03:30.696074 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 148/320] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:30 2022] GET /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2 => generated 1293 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:03:30.745946 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-a56fff35-1729-41d3-96b3-523d47a91273 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4a4bd26db664e44850f5ebccd838315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380379df1d7e4ebe90c75bcefecbc787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:30.753691 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-a56fff35-1729-41d3-96b3-523d47a91273 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] 10.222.0.36 "GET /compute/v2.1/servers/addf46fc-7cbc-4c01-a425-20630221afbd" status: 200 len: 1505 microversion: 2.1 time: 0.212828 Jul 05 13:03:30.754258 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 173/321] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:30 2022] GET /compute/v2.1/servers/addf46fc-7cbc-4c01-a425-20630221afbd => generated 1505 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:03:30.963249 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-34de51d1-700d-45bf-837a-b10ee2765e20 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:30.969531 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-34de51d1-700d-45bf-837a-b10ee2765e20 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:30.972821 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-34de51d1-700d-45bf-837a-b10ee2765e20 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:30.973320 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-34de51d1-700d-45bf-837a-b10ee2765e20 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:30.974403 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-34de51d1-700d-45bf-837a-b10ee2765e20 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:30.974845 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-34de51d1-700d-45bf-837a-b10ee2765e20 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:31.151901 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-34de51d1-700d-45bf-837a-b10ee2765e20 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:31.159789 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-34de51d1-700d-45bf-837a-b10ee2765e20 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:31.161303 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-34de51d1-700d-45bf-837a-b10ee2765e20 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:31.162459 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-34de51d1-700d-45bf-837a-b10ee2765e20 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1745 microversion: 2.20 time: 0.204677 Jul 05 13:03:31.163008 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 149/322] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:03:30 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1745 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:03:31.303415 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-58a19810-4edc-47bf-adc7-62f409076399 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:31.304328 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-58a19810-4edc-47bf-adc7-62f409076399 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 2d17971e-35b1-437a-baca-1306740b41c0] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:31.311004 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-58a19810-4edc-47bf-adc7-62f409076399 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:31.311450 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-58a19810-4edc-47bf-adc7-62f409076399 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:31.312212 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-58a19810-4edc-47bf-adc7-62f409076399 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:31.312667 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-58a19810-4edc-47bf-adc7-62f409076399 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:31.459653 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-58a19810-4edc-47bf-adc7-62f409076399 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:31.468942 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-58a19810-4edc-47bf-adc7-62f409076399 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0" status: 200 len: 1522 microversion: 2.1 time: 0.169609 Jul 05 13:03:31.469735 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 174/323] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:31 2022] GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:31.700486 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-9edfc858-90ed-4038-a3c6-a30dd3533120 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:31.701122 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-9edfc858-90ed-4038-a3c6-a30dd3533120 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: fce1b2d5-4167-4f64-9ea2-794a86830bd2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:31.707225 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9edfc858-90ed-4038-a3c6-a30dd3533120 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:31.707670 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9edfc858-90ed-4038-a3c6-a30dd3533120 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:31.708436 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9edfc858-90ed-4038-a3c6-a30dd3533120 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:31.709017 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9edfc858-90ed-4038-a3c6-a30dd3533120 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:31.771444 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-654f01a2-e7d1-4474-9edd-fe96baa4d23c tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:31.772005 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-654f01a2-e7d1-4474-9edd-fe96baa4d23c tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] [instance: addf46fc-7cbc-4c01-a425-20630221afbd] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:31.778567 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-654f01a2-e7d1-4474-9edd-fe96baa4d23c tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:31.778966 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-9edfc858-90ed-4038-a3c6-a30dd3533120 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:31.779085 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-654f01a2-e7d1-4474-9edd-fe96baa4d23c tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:31.779768 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-654f01a2-e7d1-4474-9edd-fe96baa4d23c tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:31.780200 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-654f01a2-e7d1-4474-9edd-fe96baa4d23c tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:31.787677 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-9edfc858-90ed-4038-a3c6-a30dd3533120 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2" status: 200 len: 1293 microversion: 2.1 time: 0.091117 Jul 05 13:03:31.788247 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 150/324] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:31 2022] GET /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2 => generated 1293 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:31.910572 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-654f01a2-e7d1-4474-9edd-fe96baa4d23c tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4a4bd26db664e44850f5ebccd838315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380379df1d7e4ebe90c75bcefecbc787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:31.918573 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-654f01a2-e7d1-4474-9edd-fe96baa4d23c tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] 10.222.0.36 "GET /compute/v2.1/servers/addf46fc-7cbc-4c01-a425-20630221afbd" status: 200 len: 1505 microversion: 2.1 time: 0.151147 Jul 05 13:03:31.919127 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 175/325] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:31 2022] GET /compute/v2.1/servers/addf46fc-7cbc-4c01-a425-20630221afbd => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:03:32.187155 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-11364838-6ad1-4333-a823-27db1788b4e3 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:32.187249 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-11364838-6ad1-4333-a823-27db1788b4e3 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:32.189847 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:03:32.197877 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-11364838-6ad1-4333-a823-27db1788b4e3 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:32.198687 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-11364838-6ad1-4333-a823-27db1788b4e3 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:32.202096 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-11364838-6ad1-4333-a823-27db1788b4e3 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:32.202096 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-11364838-6ad1-4333-a823-27db1788b4e3 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:32.341207 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-11364838-6ad1-4333-a823-27db1788b4e3 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:32.343881 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:03:32.357929 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-11364838-6ad1-4333-a823-27db1788b4e3 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:32.359539 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-11364838-6ad1-4333-a823-27db1788b4e3 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:32.361043 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-11364838-6ad1-4333-a823-27db1788b4e3 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1745 microversion: 2.20 time: 0.178507 Jul 05 13:03:32.361619 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 151/326] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:03:32 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1745 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:03:32.487066 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-1008a0c1-6bca-4a91-aa3b-733b21910f59 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:32.487640 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-1008a0c1-6bca-4a91-aa3b-733b21910f59 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 2d17971e-35b1-437a-baca-1306740b41c0] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:32.493666 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-1008a0c1-6bca-4a91-aa3b-733b21910f59 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:32.494117 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-1008a0c1-6bca-4a91-aa3b-733b21910f59 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:32.500175 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-1008a0c1-6bca-4a91-aa3b-733b21910f59 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:32.500175 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-1008a0c1-6bca-4a91-aa3b-733b21910f59 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:32.635170 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-1008a0c1-6bca-4a91-aa3b-733b21910f59 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:32.643007 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-1008a0c1-6bca-4a91-aa3b-733b21910f59 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0" status: 200 len: 1522 microversion: 2.1 time: 0.159826 Jul 05 13:03:32.643753 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 176/327] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:32 2022] GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:32.805525 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-31089410-937a-4d66-a015-c56adc51dd98 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:32.806143 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-31089410-937a-4d66-a015-c56adc51dd98 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: fce1b2d5-4167-4f64-9ea2-794a86830bd2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:32.815467 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-31089410-937a-4d66-a015-c56adc51dd98 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:32.815926 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-31089410-937a-4d66-a015-c56adc51dd98 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:32.817902 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-31089410-937a-4d66-a015-c56adc51dd98 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:32.817902 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-31089410-937a-4d66-a015-c56adc51dd98 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:32.885598 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-31089410-937a-4d66-a015-c56adc51dd98 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:32.895490 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-31089410-937a-4d66-a015-c56adc51dd98 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2" status: 200 len: 1293 microversion: 2.1 time: 0.093894 Jul 05 13:03:32.896904 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 152/328] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:32 2022] GET /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2 => generated 1293 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:32.936795 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-72a7ae7f-a210-49f2-bc6f-4cb76939bc99 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:32.937495 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-72a7ae7f-a210-49f2-bc6f-4cb76939bc99 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] [instance: addf46fc-7cbc-4c01-a425-20630221afbd] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:32.944070 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-72a7ae7f-a210-49f2-bc6f-4cb76939bc99 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:32.944509 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-72a7ae7f-a210-49f2-bc6f-4cb76939bc99 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:32.945285 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-72a7ae7f-a210-49f2-bc6f-4cb76939bc99 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:32.945719 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-72a7ae7f-a210-49f2-bc6f-4cb76939bc99 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:33.099777 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-72a7ae7f-a210-49f2-bc6f-4cb76939bc99 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4a4bd26db664e44850f5ebccd838315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380379df1d7e4ebe90c75bcefecbc787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:33.103451 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_cell1:SELECT=100 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:03:33.107868 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-72a7ae7f-a210-49f2-bc6f-4cb76939bc99 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] 10.222.0.36 "GET /compute/v2.1/servers/addf46fc-7cbc-4c01-a425-20630221afbd" status: 200 len: 1505 microversion: 2.1 time: 0.175093 Jul 05 13:03:33.108431 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 177/329] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:32 2022] GET /compute/v2.1/servers/addf46fc-7cbc-4c01-a425-20630221afbd => generated 1505 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:33.394473 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-948bf272-6c8c-4092-8884-abc1f3f0dcde tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:33.397569 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-948bf272-6c8c-4092-8884-abc1f3f0dcde tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:33.422253 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-948bf272-6c8c-4092-8884-abc1f3f0dcde tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:33.423147 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-948bf272-6c8c-4092-8884-abc1f3f0dcde tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:33.424875 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-948bf272-6c8c-4092-8884-abc1f3f0dcde tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:33.425587 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-948bf272-6c8c-4092-8884-abc1f3f0dcde tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:33.573050 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-948bf272-6c8c-4092-8884-abc1f3f0dcde tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:33.581993 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-948bf272-6c8c-4092-8884-abc1f3f0dcde tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:33.584028 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-948bf272-6c8c-4092-8884-abc1f3f0dcde tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:33.585262 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-948bf272-6c8c-4092-8884-abc1f3f0dcde tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1745 microversion: 2.20 time: 0.209141 Jul 05 13:03:33.585815 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 153/330] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:03:33 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1745 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:03:33.663433 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-e6000e4a-56ae-4d98-bf44-ab89d3fb2eda tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:33.663433 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-e6000e4a-56ae-4d98-bf44-ab89d3fb2eda tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 2d17971e-35b1-437a-baca-1306740b41c0] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:33.669557 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e6000e4a-56ae-4d98-bf44-ab89d3fb2eda tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:33.670001 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e6000e4a-56ae-4d98-bf44-ab89d3fb2eda tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:33.671530 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e6000e4a-56ae-4d98-bf44-ab89d3fb2eda tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:33.672671 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e6000e4a-56ae-4d98-bf44-ab89d3fb2eda tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:33.851972 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-e6000e4a-56ae-4d98-bf44-ab89d3fb2eda tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:33.861060 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-e6000e4a-56ae-4d98-bf44-ab89d3fb2eda tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0" status: 200 len: 1502 microversion: 2.1 time: 0.203781 Jul 05 13:03:33.861729 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 178/331] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:33 2022] GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0 => generated 1502 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:33.881059 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-c4a96cd3-608c-4237-8920-6cf4d960c7df tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "af1eaf8b-d89d-44a4-9611-29e41fcd1f07"}} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:03:33.884353 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-c4a96cd3-608c-4237-8920-6cf4d960c7df tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 2d17971e-35b1-437a-baca-1306740b41c0] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:33.894004 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c4a96cd3-608c-4237-8920-6cf4d960c7df tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:33.894449 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c4a96cd3-608c-4237-8920-6cf4d960c7df tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:33.896049 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c4a96cd3-608c-4237-8920-6cf4d960c7df tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:33.896480 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c4a96cd3-608c-4237-8920-6cf4d960c7df tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:33.912635 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-21d987a2-0b79-4aa8-926a-fda59aa13656 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:33.913716 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-21d987a2-0b79-4aa8-926a-fda59aa13656 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: fce1b2d5-4167-4f64-9ea2-794a86830bd2] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:33.926998 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-21d987a2-0b79-4aa8-926a-fda59aa13656 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:33.927495 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-21d987a2-0b79-4aa8-926a-fda59aa13656 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:33.928266 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-21d987a2-0b79-4aa8-926a-fda59aa13656 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:33.928725 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-21d987a2-0b79-4aa8-926a-fda59aa13656 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:33.929203 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.wsgi [None req-c4a96cd3-608c-4237-8920-6cf4d960c7df tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] HTTP exception thrown: Cannot 'attach_volume' instance 2d17971e-35b1-437a-baca-1306740b41c0 while it is in vm_state rescued Jul 05 13:03:33.932883 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-c4a96cd3-608c-4237-8920-6cf4d960c7df tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Request method failure captured: Jul 05 13:03:33.932883 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: request: POST /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0/os-volume_attachments HTTP/1.1 Jul 05 13:03:33.932883 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept: application/json Jul 05 13:03:33.932883 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept-Encoding: identity Jul 05 13:03:33.932883 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Connection: close Jul 05 13:03:33.932883 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Length: 74 Jul 05 13:03:33.932883 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Type: application/json Jul 05 13:03:33.932883 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Host: 10.222.0.36 Jul 05 13:03:33.932883 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Openstack-System-Scope: None Jul 05 13:03:33.932883 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: User-Agent: python-urllib3/1.26.9 Jul 05 13:03:33.932883 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Auth-Token: gAAAAABixDYWYD5-KTSWF-PzN5qO1tc1RakdLPjXfBvilDWsQo1psKh_qFRHuHivkKH-iP9Oa3e_8UzczAUBoqaCyIK-0JWYeWftSmLFPiSBm9nSNsIqZmt-IbMLoXnltVymxxX8qTTGlTfGqbh0uv6ByTxeigZY20vapbgvLdiiGRX9KHkTM5M Jul 05 13:03:33.932883 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Id: None Jul 05 13:03:33.932883 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Name: None Jul 05 13:03:33.932883 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Identity-Status: Confirmed Jul 05 13:03:33.932883 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Is-Admin-Project: True Jul 05 13:03:33.932883 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Id: default Jul 05 13:03:33.932883 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Name: Default Jul 05 13:03:33.932883 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Id: 7836a0ee154744b49a323e6b94860e50 Jul 05 13:03:33.932883 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1330957121 Jul 05 13:03:33.932883 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Role: member,reader Jul 05 13:03:33.932883 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Roles: member,reader Jul 05 13:03:33.935773 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7836a0ee154744b49a323e6b94860e50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7836a0ee154744b49a323e6b94860e50", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7836a0ee154744b49a323e6b94860e50"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7836a0ee154744b49a323e6b94860e50"}]}] Jul 05 13:03:33.935773 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1330957121 Jul 05 13:03:33.935773 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Id: 7836a0ee154744b49a323e6b94860e50 Jul 05 13:03:33.935773 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1330957121 Jul 05 13:03:33.935773 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User: tempest-ServerRescueNegativeTestJSON-1330957121-project Jul 05 13:03:33.935773 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Id: default Jul 05 13:03:33.935773 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Name: Default Jul 05 13:03:33.935773 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Id: ad3f91c024f8415cac4784fec0689757 Jul 05 13:03:33.935773 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1330957121-project Jul 05 13:03:33.935773 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Jul 05 13:03:33.935773 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: {"volumeAttachment": {"volumeId": "af1eaf8b-d89d-44a4-9611-29e41fcd1f07"}} Jul 05 13:03:33.935773 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: method: > Jul 05 13:03:33.936691 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: exception: Cannot 'attach_volume' instance 2d17971e-35b1-437a-baca-1306740b41c0 while it is in vm_state rescued Jul 05 13:03:33.936691 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: action_args: {'server_id': '2d17971e-35b1-437a-baca-1306740b41c0', 'body': {'volumeAttachment': {'volumeId': 'af1eaf8b-d89d-44a4-9611-29e41fcd1f07'}}} Jul 05 13:03:33.936691 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 13:03:33.936691 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:03:33.936691 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 05 13:03:33.936691 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 05 13:03:33.936691 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 05 13:03:33.936691 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 05 13:03:33.936691 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 05 13:03:33.936691 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 05 13:03:33.936691 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2d17971e-35b1-437a-baca-1306740b41c0 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 05 13:03:33.936691 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:03:33.936691 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:03:33.936691 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:03:33.936691 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:03:33.936691 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:03:33.936691 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:03:33.936691 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 13:03:33.936691 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 13:03:33.938045 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 13:03:33.938045 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 13:03:33.938045 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 05 13:03:33.938045 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 05 13:03:33.938045 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 05 13:03:33.938045 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 05 13:03:33.938045 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 05 13:03:33.938045 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 05 13:03:33.938045 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 05 13:03:33.938045 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 05 13:03:33.938045 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 05 13:03:33.938045 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 05 13:03:33.938045 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 2d17971e-35b1-437a-baca-1306740b41c0 while it is in vm_state rescued Jul 05 13:03:33.938045 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:03:33.938045 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:03:33.938045 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:03:33.938045 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:03:33.938045 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:03:33.938045 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:03:33.939254 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 13:03:33.939254 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 13:03:33.939254 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 2d17971e-35b1-437a-baca-1306740b41c0 while it is in vm_state rescued Jul 05 13:03:33.939254 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:03:33.939254 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-c4a96cd3-608c-4237-8920-6cf4d960c7df tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Returning 409 to user: Cannot 'attach_volume' instance 2d17971e-35b1-437a-baca-1306740b41c0 while it is in vm_state rescued {{(pid=118387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 13:03:33.939254 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-c4a96cd3-608c-4237-8920-6cf4d960c7df tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "POST /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.061585 Jul 05 13:03:33.939254 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 154/332] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Jul 5 13:03:33 2022] POST /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0/os-volume_attachments => generated 152 bytes in 63 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 05 13:03:33.960723 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-86be0182-29dc-42aa-a652-3dc1ae1d33d7 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:03:33.961344 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-86be0182-29dc-42aa-a652-3dc1ae1d33d7 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 2d17971e-35b1-437a-baca-1306740b41c0] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:33.973779 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-86be0182-29dc-42aa-a652-3dc1ae1d33d7 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:33.974571 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-86be0182-29dc-42aa-a652-3dc1ae1d33d7 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:33.976905 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-86be0182-29dc-42aa-a652-3dc1ae1d33d7 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:33.977515 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-86be0182-29dc-42aa-a652-3dc1ae1d33d7 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:34.007151 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-21d987a2-0b79-4aa8-926a-fda59aa13656 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:34.015151 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-21d987a2-0b79-4aa8-926a-fda59aa13656 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2" status: 200 len: 1311 microversion: 2.1 time: 0.106386 Jul 05 13:03:34.025721 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 179/333] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:33 2022] GET /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2 => generated 1311 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:03:34.125528 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-a7626420-1d20-47f3-adcf-5bd93305175c tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:34.126597 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-a7626420-1d20-47f3-adcf-5bd93305175c tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] [instance: addf46fc-7cbc-4c01-a425-20630221afbd] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:34.133293 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a7626420-1d20-47f3-adcf-5bd93305175c tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:34.133758 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a7626420-1d20-47f3-adcf-5bd93305175c tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:34.134520 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a7626420-1d20-47f3-adcf-5bd93305175c tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:34.135227 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a7626420-1d20-47f3-adcf-5bd93305175c tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:34.215072 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-a7626420-1d20-47f3-adcf-5bd93305175c tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4a4bd26db664e44850f5ebccd838315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380379df1d7e4ebe90c75bcefecbc787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:34.225140 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-a7626420-1d20-47f3-adcf-5bd93305175c tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] 10.222.0.36 "GET /compute/v2.1/servers/addf46fc-7cbc-4c01-a425-20630221afbd" status: 200 len: 1463 microversion: 2.1 time: 0.103353 Jul 05 13:03:34.226026 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 180/334] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:34 2022] GET /compute/v2.1/servers/addf46fc-7cbc-4c01-a425-20630221afbd => generated 1463 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:03:34.246299 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-86be0182-29dc-42aa-a652-3dc1ae1d33d7 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "POST /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0/action" status: 202 len: 0 microversion: 2.1 time: 0.290521 Jul 05 13:03:34.246299 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 155/335] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Jul 5 13:03:33 2022] POST /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0/action => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 13:03:34.262042 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-bb67a59f-92fc-46e1-ad4a-d4c81125f740 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:34.262669 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-bb67a59f-92fc-46e1-ad4a-d4c81125f740 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 2d17971e-35b1-437a-baca-1306740b41c0] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:34.271245 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-bb67a59f-92fc-46e1-ad4a-d4c81125f740 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:34.271697 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-bb67a59f-92fc-46e1-ad4a-d4c81125f740 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:34.272474 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-bb67a59f-92fc-46e1-ad4a-d4c81125f740 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:34.272947 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-bb67a59f-92fc-46e1-ad4a-d4c81125f740 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:34.327791 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-c7bb55e8-d610-4689-a4f7-dc54cc5133c8 req-affc5fda-4bb8-4f2a-acc8-72e8d8e584b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "addf46fc-7cbc-4c01-a425-20630221afbd", "name": "network-vif-deleted", "tag": "403e0b08-8730-430b-b04a-39db78b9ad8f"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:03:34.336049 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-c7bb55e8-d610-4689-a4f7-dc54cc5133c8 req-affc5fda-4bb8-4f2a-acc8-72e8d8e584b1 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:34.336822 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-c7bb55e8-d610-4689-a4f7-dc54cc5133c8 req-affc5fda-4bb8-4f2a-acc8-72e8d8e584b1 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:34.348441 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-c7bb55e8-d610-4689-a4f7-dc54cc5133c8 req-affc5fda-4bb8-4f2a-acc8-72e8d8e584b1 service nova] Creating event network-vif-deleted:403e0b08-8730-430b-b04a-39db78b9ad8f for instance addf46fc-7cbc-4c01-a425-20630221afbd on hv-cinder-79760 Jul 05 13:03:34.353966 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-c7bb55e8-d610-4689-a4f7-dc54cc5133c8 req-affc5fda-4bb8-4f2a-acc8-72e8d8e584b1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030217 Jul 05 13:03:34.355297 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 156/336] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:03:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:03:34.444457 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-bb67a59f-92fc-46e1-ad4a-d4c81125f740 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:34.453124 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-bb67a59f-92fc-46e1-ad4a-d4c81125f740 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0" status: 200 len: 1510 microversion: 2.1 time: 0.203702 Jul 05 13:03:34.454136 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 181/337] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:34 2022] GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0 => generated 1510 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:34.607195 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-a9c58c6e-6681-4a1f-9e68-175a6d180f13 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:34.608363 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-a9c58c6e-6681-4a1f-9e68-175a6d180f13 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:34.619097 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a9c58c6e-6681-4a1f-9e68-175a6d180f13 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:34.619946 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a9c58c6e-6681-4a1f-9e68-175a6d180f13 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:34.621452 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a9c58c6e-6681-4a1f-9e68-175a6d180f13 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:34.622039 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a9c58c6e-6681-4a1f-9e68-175a6d180f13 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:34.803445 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-a9c58c6e-6681-4a1f-9e68-175a6d180f13 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:34.815631 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-a9c58c6e-6681-4a1f-9e68-175a6d180f13 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:34.817704 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-a9c58c6e-6681-4a1f-9e68-175a6d180f13 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:34.818982 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-a9c58c6e-6681-4a1f-9e68-175a6d180f13 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1740 microversion: 2.20 time: 0.218667 Jul 05 13:03:34.822707 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 157/338] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:03:34 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1740 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:03:35.033707 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-b7602ab9-78be-4301-b666-920845112749 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:35.034465 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-b7602ab9-78be-4301-b666-920845112749 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: fce1b2d5-4167-4f64-9ea2-794a86830bd2] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:35.044572 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_api:SELECT=94 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:03:35.044572 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b7602ab9-78be-4301-b666-920845112749 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:35.044572 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b7602ab9-78be-4301-b666-920845112749 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:35.044572 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b7602ab9-78be-4301-b666-920845112749 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:35.045195 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b7602ab9-78be-4301-b666-920845112749 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:35.243803 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-942d5a24-b423-4a26-8f22-ca88b9872193 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:35.244402 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-942d5a24-b423-4a26-8f22-ca88b9872193 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] [instance: addf46fc-7cbc-4c01-a425-20630221afbd] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:35.247636 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-b7602ab9-78be-4301-b666-920845112749 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:35.262353 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-942d5a24-b423-4a26-8f22-ca88b9872193 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:35.268349 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-942d5a24-b423-4a26-8f22-ca88b9872193 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:35.268349 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-942d5a24-b423-4a26-8f22-ca88b9872193 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:35.268349 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-942d5a24-b423-4a26-8f22-ca88b9872193 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:35.268926 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-b7602ab9-78be-4301-b666-920845112749 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2" status: 200 len: 1367 microversion: 2.1 time: 0.239086 Jul 05 13:03:35.269355 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 182/339] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:35 2022] GET /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2 => generated 1367 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:35.378969 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-942d5a24-b423-4a26-8f22-ca88b9872193 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:35.379437 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-942d5a24-b423-4a26-8f22-ca88b9872193 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:35.379935 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.objects.instance [None req-942d5a24-b423-4a26-8f22-ca88b9872193 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lazy-loading 'fault' on Instance uuid addf46fc-7cbc-4c01-a425-20630221afbd {{(pid=118387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 13:03:35.470970 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-942d5a24-b423-4a26-8f22-ca88b9872193 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4a4bd26db664e44850f5ebccd838315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380379df1d7e4ebe90c75bcefecbc787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:35.478990 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-d4537972-46d7-499a-bd0b-5d2127861382 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:35.481039 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-942d5a24-b423-4a26-8f22-ca88b9872193 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] 10.222.0.36 "GET /compute/v2.1/servers/addf46fc-7cbc-4c01-a425-20630221afbd" status: 200 len: 1304 microversion: 2.1 time: 0.242268 Jul 05 13:03:35.481792 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 158/340] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:35 2022] GET /compute/v2.1/servers/addf46fc-7cbc-4c01-a425-20630221afbd => generated 1304 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:35.483802 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-d4537972-46d7-499a-bd0b-5d2127861382 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 2d17971e-35b1-437a-baca-1306740b41c0] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:35.493757 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-d4537972-46d7-499a-bd0b-5d2127861382 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:35.504702 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-d4537972-46d7-499a-bd0b-5d2127861382 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:35.507285 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-d4537972-46d7-499a-bd0b-5d2127861382 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:35.509430 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-d4537972-46d7-499a-bd0b-5d2127861382 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:35.671236 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-9a862b86-ecfd-4e07-a582-050a557aa5b7 req-01796c5b-2828-4157-972c-517ba384ef89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72285b0b-7735-422b-b110-ef7b03fb367f", "name": "network-vif-plugged", "status": "completed", "tag": "caf3b4b2-126a-423d-b8ca-4680670bb511"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:03:35.684810 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-9a862b86-ecfd-4e07-a582-050a557aa5b7 req-01796c5b-2828-4157-972c-517ba384ef89 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:35.685816 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-9a862b86-ecfd-4e07-a582-050a557aa5b7 req-01796c5b-2828-4157-972c-517ba384ef89 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:35.718027 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-9a862b86-ecfd-4e07-a582-050a557aa5b7 req-01796c5b-2828-4157-972c-517ba384ef89 service nova] Creating event network-vif-plugged:caf3b4b2-126a-423d-b8ca-4680670bb511 for instance 72285b0b-7735-422b-b110-ef7b03fb367f on hv-cinder-79760 Jul 05 13:03:35.724231 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-9a862b86-ecfd-4e07-a582-050a557aa5b7 req-01796c5b-2828-4157-972c-517ba384ef89 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057319 Jul 05 13:03:35.725616 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 159/341] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:03:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 13:03:35.841575 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-840cf98d-d966-4034-aab9-742ec2a1d22c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:35.843017 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-840cf98d-d966-4034-aab9-742ec2a1d22c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:35.856077 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-840cf98d-d966-4034-aab9-742ec2a1d22c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:35.859992 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-840cf98d-d966-4034-aab9-742ec2a1d22c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:35.868101 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-840cf98d-d966-4034-aab9-742ec2a1d22c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:35.870323 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-840cf98d-d966-4034-aab9-742ec2a1d22c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:35.871328 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-d4537972-46d7-499a-bd0b-5d2127861382 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:35.891562 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-d4537972-46d7-499a-bd0b-5d2127861382 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0" status: 200 len: 1510 microversion: 2.1 time: 0.417610 Jul 05 13:03:35.892214 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 183/342] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:35 2022] GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0 => generated 1510 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:36.179470 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-840cf98d-d966-4034-aab9-742ec2a1d22c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:36.192802 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-840cf98d-d966-4034-aab9-742ec2a1d22c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:36.198471 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-840cf98d-d966-4034-aab9-742ec2a1d22c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:36.200045 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-840cf98d-d966-4034-aab9-742ec2a1d22c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1740 microversion: 2.20 time: 0.363426 Jul 05 13:03:36.201697 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 160/343] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:03:35 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1740 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 13:03:36.287498 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-da435a5b-0543-41f7-9c33-2a8cf716220c tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:36.288108 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-da435a5b-0543-41f7-9c33-2a8cf716220c tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: fce1b2d5-4167-4f64-9ea2-794a86830bd2] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:36.298645 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-da435a5b-0543-41f7-9c33-2a8cf716220c tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:36.299094 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-da435a5b-0543-41f7-9c33-2a8cf716220c tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:36.300066 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-da435a5b-0543-41f7-9c33-2a8cf716220c tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:36.300964 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-da435a5b-0543-41f7-9c33-2a8cf716220c tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:36.505486 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-da435a5b-0543-41f7-9c33-2a8cf716220c tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:36.508499 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-5ee72e8c-5c9a-4a31-a7ff-80894b713416 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:36.509390 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-5ee72e8c-5c9a-4a31-a7ff-80894b713416 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] [instance: addf46fc-7cbc-4c01-a425-20630221afbd] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:36.519563 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5ee72e8c-5c9a-4a31-a7ff-80894b713416 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:36.520702 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5ee72e8c-5c9a-4a31-a7ff-80894b713416 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:36.524978 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-da435a5b-0543-41f7-9c33-2a8cf716220c tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2" status: 200 len: 1367 microversion: 2.1 time: 0.242070 Jul 05 13:03:36.525731 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5ee72e8c-5c9a-4a31-a7ff-80894b713416 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:36.526960 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5ee72e8c-5c9a-4a31-a7ff-80894b713416 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:36.534761 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 184/344] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:36 2022] GET /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2 => generated 1367 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:36.559035 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.wsgi [None req-5ee72e8c-5c9a-4a31-a7ff-80894b713416 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] HTTP exception thrown: Instance addf46fc-7cbc-4c01-a425-20630221afbd could not be found. Jul 05 13:03:36.561873 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-5ee72e8c-5c9a-4a31-a7ff-80894b713416 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Request method failure captured: Jul 05 13:03:36.561873 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: request: GET /compute/v2.1/servers/addf46fc-7cbc-4c01-a425-20630221afbd HTTP/1.1 Jul 05 13:03:36.561873 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept: application/json Jul 05 13:03:36.561873 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept-Encoding: identity Jul 05 13:03:36.561873 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Connection: close Jul 05 13:03:36.561873 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Length: 0 Jul 05 13:03:36.561873 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Type: application/json Jul 05 13:03:36.561873 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Host: 10.222.0.36 Jul 05 13:03:36.561873 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Openstack-System-Scope: None Jul 05 13:03:36.561873 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: User-Agent: python-urllib3/1.26.9 Jul 05 13:03:36.561873 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Auth-Token: gAAAAABixDZ-_lja90p43bDO3L_ckPEmTL6OIpajOKTRKGMy2qmcTgUYWLdmGnOY8fF6Vm3IwvVlAGjDTpGOvVLf-0czv5sVp6fw_lU0Bz5qmF69upzCjGw1Nwvvk9oGmxyiKnCs0_r7WpHF-i6Ax2GS0qhMlqg_IX0b_IG5cFmDD37eFil6raI Jul 05 13:03:36.561873 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Id: None Jul 05 13:03:36.561873 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Name: None Jul 05 13:03:36.561873 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Identity-Status: Confirmed Jul 05 13:03:36.561873 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Is-Admin-Project: True Jul 05 13:03:36.561873 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Id: default Jul 05 13:03:36.561873 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Name: Default Jul 05 13:03:36.561873 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Id: 380379df1d7e4ebe90c75bcefecbc787 Jul 05 13:03:36.561873 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Name: tempest-VolumesActionsTest-616891412 Jul 05 13:03:36.561873 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Role: member,reader Jul 05 13:03:36.561873 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Roles: member,reader Jul 05 13:03:36.563193 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/380379df1d7e4ebe90c75bcefecbc787"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_380379df1d7e4ebe90c75bcefecbc787", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/380379df1d7e4ebe90c75bcefecbc787"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/380379df1d7e4ebe90c75bcefecbc787"}]}] Jul 05 13:03:36.563193 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant: tempest-VolumesActionsTest-616891412 Jul 05 13:03:36.563193 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Id: 380379df1d7e4ebe90c75bcefecbc787 Jul 05 13:03:36.563193 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Name: tempest-VolumesActionsTest-616891412 Jul 05 13:03:36.563193 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User: tempest-VolumesActionsTest-616891412-project Jul 05 13:03:36.563193 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Id: default Jul 05 13:03:36.563193 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Name: Default Jul 05 13:03:36.563193 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Id: e4a4bd26db664e44850f5ebccd838315 Jul 05 13:03:36.563193 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Name: tempest-VolumesActionsTest-616891412-project Jul 05 13:03:36.563193 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: method: > Jul 05 13:03:36.563193 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: exception: Instance addf46fc-7cbc-4c01-a425-20630221afbd could not be found. Jul 05 13:03:36.563193 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: action_args: {'id': 'addf46fc-7cbc-4c01-a425-20630221afbd'} Jul 05 13:03:36.563949 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 13:03:36.563949 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:03:36.563949 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 13:03:36.563949 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 13:03:36.563949 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 13:03:36.563949 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 13:03:36.563949 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 13:03:36.563949 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 13:03:36.563949 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 13:03:36.563949 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 13:03:36.563949 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance addf46fc-7cbc-4c01-a425-20630221afbd could not be found. Jul 05 13:03:36.563949 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:03:36.563949 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:03:36.563949 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:03:36.563949 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:03:36.563949 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:03:36.563949 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:03:36.563949 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 13:03:36.563949 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 13:03:36.563949 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 13:03:36.565225 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 13:03:36.565225 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 13:03:36.565225 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 13:03:36.565225 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 13:03:36.565225 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 13:03:36.565225 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 13:03:36.565225 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 13:03:36.565225 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance addf46fc-7cbc-4c01-a425-20630221afbd could not be found. Jul 05 13:03:36.565225 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:03:36.565225 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:03:36.565225 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:03:36.565225 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:03:36.565225 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:03:36.565225 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:03:36.565225 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 13:03:36.565225 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 13:03:36.565225 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance addf46fc-7cbc-4c01-a425-20630221afbd could not be found. Jul 05 13:03:36.565225 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:03:36.568320 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-5ee72e8c-5c9a-4a31-a7ff-80894b713416 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Returning 404 to user: Instance addf46fc-7cbc-4c01-a425-20630221afbd could not be found. {{(pid=118387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 13:03:36.569719 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-5ee72e8c-5c9a-4a31-a7ff-80894b713416 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] 10.222.0.36 "GET /compute/v2.1/servers/addf46fc-7cbc-4c01-a425-20630221afbd" status: 404 len: 111 microversion: 2.1 time: 0.065780 Jul 05 13:03:36.570447 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 161/345] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:36 2022] GET /compute/v2.1/servers/addf46fc-7cbc-4c01-a425-20630221afbd => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 13:03:36.753649 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-738a2c83-fa3e-44e0-8da4-408d22d7ad43 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1581288428", "imageRef": "d6134305-a5c0-4d2c-afc8-e54be21f685c", "flavorRef": "452", "networks": [{"uuid": "27cb194b-43db-4891-bf2d-40d312523013"}]}} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:03:36.910036 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-1a65eb88-7446-41b1-bdb1-f1f9dd707603 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:36.913165 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-1a65eb88-7446-41b1-bdb1-f1f9dd707603 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 2d17971e-35b1-437a-baca-1306740b41c0] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:36.922600 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1a65eb88-7446-41b1-bdb1-f1f9dd707603 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:36.923061 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1a65eb88-7446-41b1-bdb1-f1f9dd707603 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:36.923880 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1a65eb88-7446-41b1-bdb1-f1f9dd707603 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:36.924318 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1a65eb88-7446-41b1-bdb1-f1f9dd707603 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:37.023075 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell0:SELECT=14 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:03:37.170073 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-1a65eb88-7446-41b1-bdb1-f1f9dd707603 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:37.197036 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-1a65eb88-7446-41b1-bdb1-f1f9dd707603 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0" status: 200 len: 1510 microversion: 2.1 time: 0.291019 Jul 05 13:03:37.198268 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 162/346] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:36 2022] GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0 => generated 1510 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:37.233560 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-4706286b-488e-490f-bde8-1c4f3ce8c744 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:37.239411 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-4706286b-488e-490f-bde8-1c4f3ce8c744 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:37.256496 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4706286b-488e-490f-bde8-1c4f3ce8c744 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:37.258651 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4706286b-488e-490f-bde8-1c4f3ce8c744 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:37.259865 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4706286b-488e-490f-bde8-1c4f3ce8c744 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:37.260243 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4706286b-488e-490f-bde8-1c4f3ce8c744 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:37.583984 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-4706286b-488e-490f-bde8-1c4f3ce8c744 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:37.602736 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-4706286b-488e-490f-bde8-1c4f3ce8c744 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:37.604998 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-4706286b-488e-490f-bde8-1c4f3ce8c744 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:37.607126 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-4706286b-488e-490f-bde8-1c4f3ce8c744 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1740 microversion: 2.20 time: 0.387202 Jul 05 13:03:37.608398 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 163/347] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:03:37 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1740 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:03:37.632375 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-961332a0-4130-4773-88df-6503ae2ada04 req-fac4301a-cea5-4db1-9447-09d1fdf89df5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fce1b2d5-4167-4f64-9ea2-794a86830bd2", "tag": "8a5a6e9b-a8fd-4e32-a9e6-6141c6a65210"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:03:37.643474 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-961332a0-4130-4773-88df-6503ae2ada04 req-fac4301a-cea5-4db1-9447-09d1fdf89df5 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:37.644312 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-961332a0-4130-4773-88df-6503ae2ada04 req-fac4301a-cea5-4db1-9447-09d1fdf89df5 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:37.656806 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-961332a0-4130-4773-88df-6503ae2ada04 req-fac4301a-cea5-4db1-9447-09d1fdf89df5 service nova] Creating event network-changed:8a5a6e9b-a8fd-4e32-a9e6-6141c6a65210 for instance fce1b2d5-4167-4f64-9ea2-794a86830bd2 on hv-cinder-79760 Jul 05 13:03:37.677690 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-961332a0-4130-4773-88df-6503ae2ada04 req-fac4301a-cea5-4db1-9447-09d1fdf89df5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050825 Jul 05 13:03:37.678731 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 164/348] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:03:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:03:37.685909 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-5681b210-0474-410a-bf32-8c98ebfacb86 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:37.686960 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-5681b210-0474-410a-bf32-8c98ebfacb86 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: fce1b2d5-4167-4f64-9ea2-794a86830bd2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:37.694349 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5681b210-0474-410a-bf32-8c98ebfacb86 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:37.695222 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5681b210-0474-410a-bf32-8c98ebfacb86 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:37.699766 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5681b210-0474-410a-bf32-8c98ebfacb86 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:37.700742 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5681b210-0474-410a-bf32-8c98ebfacb86 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:37.875852 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-5681b210-0474-410a-bf32-8c98ebfacb86 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:37.884550 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-5681b210-0474-410a-bf32-8c98ebfacb86 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2" status: 200 len: 1367 microversion: 2.1 time: 0.203946 Jul 05 13:03:37.887595 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 165/349] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:37 2022] GET /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2 => generated 1367 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:38.214637 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-65aa9620-88df-4185-bd2c-e29fd321f714 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:38.215784 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-65aa9620-88df-4185-bd2c-e29fd321f714 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 2d17971e-35b1-437a-baca-1306740b41c0] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:38.227836 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-65aa9620-88df-4185-bd2c-e29fd321f714 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:38.228288 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-65aa9620-88df-4185-bd2c-e29fd321f714 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:38.229137 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-65aa9620-88df-4185-bd2c-e29fd321f714 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:38.229581 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-65aa9620-88df-4185-bd2c-e29fd321f714 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:38.474160 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-65aa9620-88df-4185-bd2c-e29fd321f714 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:38.483199 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-65aa9620-88df-4185-bd2c-e29fd321f714 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0" status: 200 len: 1516 microversion: 2.1 time: 0.272175 Jul 05 13:03:38.484661 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 166/350] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:38 2022] GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0 => generated 1516 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:38.632830 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-f4fb58fa-4042-46ce-ac9e-17b902842d2a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:38.633605 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-f4fb58fa-4042-46ce-ac9e-17b902842d2a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:38.646659 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f4fb58fa-4042-46ce-ac9e-17b902842d2a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:38.649004 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f4fb58fa-4042-46ce-ac9e-17b902842d2a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:38.650134 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f4fb58fa-4042-46ce-ac9e-17b902842d2a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:38.650896 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f4fb58fa-4042-46ce-ac9e-17b902842d2a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:38.837334 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-f4fb58fa-4042-46ce-ac9e-17b902842d2a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:38.850283 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-f4fb58fa-4042-46ce-ac9e-17b902842d2a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:38.853427 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-f4fb58fa-4042-46ce-ac9e-17b902842d2a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:38.855210 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-f4fb58fa-4042-46ce-ac9e-17b902842d2a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1740 microversion: 2.20 time: 0.227904 Jul 05 13:03:38.856095 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 167/351] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:03:38 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1740 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:03:38.910094 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-cc3e79a3-b142-488f-9879-00ea13f064e6 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:38.911071 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-cc3e79a3-b142-488f-9879-00ea13f064e6 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: fce1b2d5-4167-4f64-9ea2-794a86830bd2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:38.917887 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cc3e79a3-b142-488f-9879-00ea13f064e6 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:38.918345 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cc3e79a3-b142-488f-9879-00ea13f064e6 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:38.919138 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cc3e79a3-b142-488f-9879-00ea13f064e6 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:38.919578 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cc3e79a3-b142-488f-9879-00ea13f064e6 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:39.192142 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-cc3e79a3-b142-488f-9879-00ea13f064e6 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:39.227503 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-cc3e79a3-b142-488f-9879-00ea13f064e6 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2" status: 200 len: 1367 microversion: 2.1 time: 0.321360 Jul 05 13:03:39.228626 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 168/352] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:38 2022] GET /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2 => generated 1367 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:03:39.874101 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-264fbd99-088c-4c3e-950f-c828245c67a9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:39.874709 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-264fbd99-088c-4c3e-950f-c828245c67a9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:39.894161 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-264fbd99-088c-4c3e-950f-c828245c67a9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:39.894600 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-264fbd99-088c-4c3e-950f-c828245c67a9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:39.895967 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-264fbd99-088c-4c3e-950f-c828245c67a9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:39.896394 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-264fbd99-088c-4c3e-950f-c828245c67a9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:40.212553 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-264fbd99-088c-4c3e-950f-c828245c67a9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:40.227431 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-264fbd99-088c-4c3e-950f-c828245c67a9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:40.229512 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-264fbd99-088c-4c3e-950f-c828245c67a9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:40.230715 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-264fbd99-088c-4c3e-950f-c828245c67a9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1740 microversion: 2.20 time: 0.360555 Jul 05 13:03:40.240431 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 169/353] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:03:39 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1740 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 13:03:40.247741 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-8b0c1601-f32a-40f3-96e2-af4afcb288d1 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:40.248502 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-8b0c1601-f32a-40f3-96e2-af4afcb288d1 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: fce1b2d5-4167-4f64-9ea2-794a86830bd2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:40.257314 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8b0c1601-f32a-40f3-96e2-af4afcb288d1 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:40.258056 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8b0c1601-f32a-40f3-96e2-af4afcb288d1 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:40.259188 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8b0c1601-f32a-40f3-96e2-af4afcb288d1 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:40.259871 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8b0c1601-f32a-40f3-96e2-af4afcb288d1 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:40.268273 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:03:40.768624 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-8b0c1601-f32a-40f3-96e2-af4afcb288d1 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:40.798746 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-8b0c1601-f32a-40f3-96e2-af4afcb288d1 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2" status: 200 len: 1367 microversion: 2.1 time: 0.556985 Jul 05 13:03:40.801117 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 170/354] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:40 2022] GET /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2 => generated 1367 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:40.814789 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-edc3cf71-8fc5-4b64-af99-04597f8781a0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Action: 'create', calling method: .version_select at 0x7f70de909160>, body: {"keypair": {"name": "tempest-keypair-657695244", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHNFh1b8gBNKt2+BsPl609DUsxCF8iqq6ZV5tPkXZd7Z9yAKiFQDzP3Pi1P3dD0izZBXanA44zuS65bvsJOo48CGqEBeNCuNiIrAJrTC50xs+Kta5iiAJ/eqzEgqoj4W3Q=="}} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:03:40.830192 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.quota [None req-edc3cf71-8fc5-4b64-af99-04597f8781a0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Getting quotas for project 7836a0ee154744b49a323e6b94860e50. Resources: {'key_pairs'} {{(pid=118387) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 13:03:40.836553 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.quota [None req-edc3cf71-8fc5-4b64-af99-04597f8781a0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Getting quotas for user ad3f91c024f8415cac4784fec0689757 and project 7836a0ee154744b49a323e6b94860e50. Resources: {'key_pairs'} {{(pid=118387) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 13:03:40.970747 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-edc3cf71-8fc5-4b64-af99-04597f8781a0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.169792 Jul 05 13:03:40.971420 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 171/355] 10.222.0.36 () {60 vars in 1158 bytes} [Tue Jul 5 13:03:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:03:41.261732 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-35d7a773-d041-4b5e-b4f2-e937b4be3307 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:41.262538 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-35d7a773-d041-4b5e-b4f2-e937b4be3307 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:41.275522 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-35d7a773-d041-4b5e-b4f2-e937b4be3307 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:41.278606 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-35d7a773-d041-4b5e-b4f2-e937b4be3307 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:41.280782 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-35d7a773-d041-4b5e-b4f2-e937b4be3307 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:41.281326 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-35d7a773-d041-4b5e-b4f2-e937b4be3307 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:41.487140 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-35d7a773-d041-4b5e-b4f2-e937b4be3307 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:41.503347 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-35d7a773-d041-4b5e-b4f2-e937b4be3307 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:41.509144 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-35d7a773-d041-4b5e-b4f2-e937b4be3307 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:41.509144 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-35d7a773-d041-4b5e-b4f2-e937b4be3307 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1740 microversion: 2.20 time: 0.251811 Jul 05 13:03:41.509144 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 172/356] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:03:41 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1740 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:03:41.822078 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-6f487dd7-69cb-4041-bd9a-dc48b38682d1 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:41.823023 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-6f487dd7-69cb-4041-bd9a-dc48b38682d1 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: fce1b2d5-4167-4f64-9ea2-794a86830bd2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:41.833783 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6f487dd7-69cb-4041-bd9a-dc48b38682d1 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:41.834958 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6f487dd7-69cb-4041-bd9a-dc48b38682d1 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:41.837957 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6f487dd7-69cb-4041-bd9a-dc48b38682d1 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:41.838845 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6f487dd7-69cb-4041-bd9a-dc48b38682d1 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:42.146353 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-6f487dd7-69cb-4041-bd9a-dc48b38682d1 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:42.166812 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-6f487dd7-69cb-4041-bd9a-dc48b38682d1 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2" status: 200 len: 1367 microversion: 2.1 time: 0.339490 Jul 05 13:03:42.174262 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 173/357] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:41 2022] GET /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2 => generated 1367 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:42.529795 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-2942ac42-859b-45a5-8628-ba0afce10443 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:42.530841 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-2942ac42-859b-45a5-8628-ba0afce10443 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:42.541271 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2942ac42-859b-45a5-8628-ba0afce10443 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:42.542086 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2942ac42-859b-45a5-8628-ba0afce10443 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:42.543157 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2942ac42-859b-45a5-8628-ba0afce10443 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:42.543679 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2942ac42-859b-45a5-8628-ba0afce10443 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:42.806347 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-2942ac42-859b-45a5-8628-ba0afce10443 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:42.827956 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-2942ac42-859b-45a5-8628-ba0afce10443 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:42.829539 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-2942ac42-859b-45a5-8628-ba0afce10443 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:42.830727 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-2942ac42-859b-45a5-8628-ba0afce10443 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1740 microversion: 2.20 time: 0.308771 Jul 05 13:03:42.836637 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 174/358] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:03:42 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1740 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:03:43.191375 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-2a073bc7-3218-4f39-944c-56a41b47fef6 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:43.193037 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-2a073bc7-3218-4f39-944c-56a41b47fef6 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: fce1b2d5-4167-4f64-9ea2-794a86830bd2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:43.200151 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2a073bc7-3218-4f39-944c-56a41b47fef6 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:43.200630 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2a073bc7-3218-4f39-944c-56a41b47fef6 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:43.201419 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2a073bc7-3218-4f39-944c-56a41b47fef6 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:43.201855 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2a073bc7-3218-4f39-944c-56a41b47fef6 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:43.386880 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-2a073bc7-3218-4f39-944c-56a41b47fef6 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:43.394463 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-2a073bc7-3218-4f39-944c-56a41b47fef6 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2" status: 200 len: 1367 microversion: 2.1 time: 0.207960 Jul 05 13:03:43.395540 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 175/359] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:43 2022] GET /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2 => generated 1367 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:43.848497 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-7d1af5a7-a357-4312-b4a9-c1bff48e86d0 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:43.851172 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-7d1af5a7-a357-4312-b4a9-c1bff48e86d0 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:43.855962 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7d1af5a7-a357-4312-b4a9-c1bff48e86d0 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:43.856413 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7d1af5a7-a357-4312-b4a9-c1bff48e86d0 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:43.858289 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7d1af5a7-a357-4312-b4a9-c1bff48e86d0 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:43.858725 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7d1af5a7-a357-4312-b4a9-c1bff48e86d0 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:43.992306 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.network.neutron [None req-738a2c83-fa3e-44e0-8da4-408d22d7ad43 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] validate_networks() for [('27cb194b-43db-4891-bf2d-40d312523013', None, None, None, None, None)] {{(pid=118386) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 13:03:44.039505 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-7d1af5a7-a357-4312-b4a9-c1bff48e86d0 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:44.052468 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-7d1af5a7-a357-4312-b4a9-c1bff48e86d0 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:44.064791 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-7d1af5a7-a357-4312-b4a9-c1bff48e86d0 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:44.066350 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-7d1af5a7-a357-4312-b4a9-c1bff48e86d0 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1740 microversion: 2.20 time: 0.221874 Jul 05 13:03:44.068809 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 176/360] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:03:43 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1740 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 13:03:44.414847 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-27b58883-7b98-4714-8727-86ccddaa44b2 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:44.415579 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-27b58883-7b98-4714-8727-86ccddaa44b2 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: fce1b2d5-4167-4f64-9ea2-794a86830bd2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:44.425411 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-27b58883-7b98-4714-8727-86ccddaa44b2 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:44.428313 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-27b58883-7b98-4714-8727-86ccddaa44b2 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:44.430816 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-27b58883-7b98-4714-8727-86ccddaa44b2 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:44.432426 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-27b58883-7b98-4714-8727-86ccddaa44b2 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:44.713291 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-27b58883-7b98-4714-8727-86ccddaa44b2 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:44.728168 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-27b58883-7b98-4714-8727-86ccddaa44b2 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2" status: 200 len: 1367 microversion: 2.1 time: 0.316742 Jul 05 13:03:44.728783 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 177/361] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:44 2022] GET /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2 => generated 1367 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:44.737849 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-f3d6b4fe-7eac-4e22-a9f8-916ad50a07bd tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2105825327", "imageRef": "d6134305-a5c0-4d2c-afc8-e54be21f685c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f39eed6c-2ca3-432a-8440-fb8b99c5c5bb"}], "security_groups": [{"name": "tempest-securitygroup--1168000457"}], "key_name": "tempest-keypair-657695244", "user_data": "}} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:03:44.759971 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.virt.hardware [None req-738a2c83-fa3e-44e0-8da4-408d22d7ad43 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Flavor limits 0:0:0 {{(pid=118386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 13:03:44.760908 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.virt.hardware [None req-738a2c83-fa3e-44e0-8da4-408d22d7ad43 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Image limits 0:0:0 {{(pid=118386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 13:03:44.762671 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.virt.hardware [None req-738a2c83-fa3e-44e0-8da4-408d22d7ad43 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Flavor pref 0:0:0 {{(pid=118386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 13:03:44.763269 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.virt.hardware [None req-738a2c83-fa3e-44e0-8da4-408d22d7ad43 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Image pref 0:0:0 {{(pid=118386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 13:03:44.763845 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.virt.hardware [None req-738a2c83-fa3e-44e0-8da4-408d22d7ad43 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 13:03:44.774919 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-738a2c83-fa3e-44e0-8da4-408d22d7ad43 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:44.775369 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-738a2c83-fa3e-44e0-8da4-408d22d7ad43 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:44.776516 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-738a2c83-fa3e-44e0-8da4-408d22d7ad43 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:44.777147 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-738a2c83-fa3e-44e0-8da4-408d22d7ad43 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:44.804378 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.quota [None req-738a2c83-fa3e-44e0-8da4-408d22d7ad43 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Getting quotas for project 380379df1d7e4ebe90c75bcefecbc787. Resources: {'instances', 'cores', 'ram'} {{(pid=118386) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 13:03:44.815427 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.quota [None req-738a2c83-fa3e-44e0-8da4-408d22d7ad43 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Getting quotas for user e4a4bd26db664e44850f5ebccd838315 and project 380379df1d7e4ebe90c75bcefecbc787. Resources: {'instances', 'cores', 'ram'} {{(pid=118386) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 13:03:44.829916 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-738a2c83-fa3e-44e0-8da4-408d22d7ad43 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Going to run 1 instances... {{(pid=118386) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 13:03:44.832647 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-738a2c83-fa3e-44e0-8da4-408d22d7ad43 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] [instance: 058a9566-8f0f-4920-b435-22ea5bee15e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d6134305-a5c0-4d2c-afc8-e54be21f685c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118386) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 13:03:44.866084 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.network.neutron [None req-f3d6b4fe-7eac-4e22-a9f8-916ad50a07bd tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] validate_networks() for [('f39eed6c-2ca3-432a-8440-fb8b99c5c5bb', None, None, None, None, None)] {{(pid=118387) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 13:03:45.006480 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-738a2c83-fa3e-44e0-8da4-408d22d7ad43 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 8.247344 Jul 05 13:03:45.006480 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 185/362] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jul 5 13:03:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 8251 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 05 13:03:45.011501 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-58325630-e247-486c-8ca6-4c2075d08371 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:45.013179 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-58325630-e247-486c-8ca6-4c2075d08371 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] [instance: 058a9566-8f0f-4920-b435-22ea5bee15e7] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:45.149462 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-58325630-e247-486c-8ca6-4c2075d08371 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4a4bd26db664e44850f5ebccd838315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380379df1d7e4ebe90c75bcefecbc787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:45.157114 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-58325630-e247-486c-8ca6-4c2075d08371 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] 10.222.0.36 "GET /compute/v2.1/servers/058a9566-8f0f-4920-b435-22ea5bee15e7" status: 200 len: 1214 microversion: 2.1 time: 0.149395 Jul 05 13:03:45.157677 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 186/363] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:45 2022] GET /compute/v2.1/servers/058a9566-8f0f-4920-b435-22ea5bee15e7 => generated 1214 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:03:45.177951 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-1ec78e96-9af0-42e0-a952-aadd3565141f tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:45.180350 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-1ec78e96-9af0-42e0-a952-aadd3565141f tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:45.189775 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-1ec78e96-9af0-42e0-a952-aadd3565141f tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:45.190322 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-1ec78e96-9af0-42e0-a952-aadd3565141f tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:45.202046 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-1ec78e96-9af0-42e0-a952-aadd3565141f tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:45.202699 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-1ec78e96-9af0-42e0-a952-aadd3565141f tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:45.487078 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-1ec78e96-9af0-42e0-a952-aadd3565141f tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:45.500275 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-1ec78e96-9af0-42e0-a952-aadd3565141f tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:45.501907 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-1ec78e96-9af0-42e0-a952-aadd3565141f tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:45.531561 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-1ec78e96-9af0-42e0-a952-aadd3565141f tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1740 microversion: 2.20 time: 0.339339 Jul 05 13:03:45.531561 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 187/364] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:03:45 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1740 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:03:45.577983 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-f3d6b4fe-7eac-4e22-a9f8-916ad50a07bd tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Flavor limits 0:0:0 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 13:03:45.579190 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-f3d6b4fe-7eac-4e22-a9f8-916ad50a07bd tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Image limits 0:0:0 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 13:03:45.579675 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-f3d6b4fe-7eac-4e22-a9f8-916ad50a07bd tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Flavor pref 0:0:0 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 13:03:45.580091 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-f3d6b4fe-7eac-4e22-a9f8-916ad50a07bd tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Image pref 0:0:0 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 13:03:45.580515 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-f3d6b4fe-7eac-4e22-a9f8-916ad50a07bd tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 13:03:45.599495 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f3d6b4fe-7eac-4e22-a9f8-916ad50a07bd tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:45.600117 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f3d6b4fe-7eac-4e22-a9f8-916ad50a07bd tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:45.601153 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f3d6b4fe-7eac-4e22-a9f8-916ad50a07bd tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:45.602020 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f3d6b4fe-7eac-4e22-a9f8-916ad50a07bd tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:45.642421 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.quota [None req-f3d6b4fe-7eac-4e22-a9f8-916ad50a07bd tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Getting quotas for project 7836a0ee154744b49a323e6b94860e50. Resources: {'instances', 'cores', 'ram'} {{(pid=118387) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 13:03:45.654643 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.quota [None req-f3d6b4fe-7eac-4e22-a9f8-916ad50a07bd tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Getting quotas for user ad3f91c024f8415cac4784fec0689757 and project 7836a0ee154744b49a323e6b94860e50. Resources: {'instances', 'cores', 'ram'} {{(pid=118387) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 13:03:45.668206 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-f3d6b4fe-7eac-4e22-a9f8-916ad50a07bd tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Going to run 1 instances... {{(pid=118387) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 13:03:45.671753 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-f3d6b4fe-7eac-4e22-a9f8-916ad50a07bd tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 7b7f15b2-a00e-4172-983d-f2a80401953b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d6134305-a5c0-4d2c-afc8-e54be21f685c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118387) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 13:03:45.747527 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-9d104add-1ea7-4a09-8447-12dd384e18ad tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:45.747527 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-9d104add-1ea7-4a09-8447-12dd384e18ad tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: fce1b2d5-4167-4f64-9ea2-794a86830bd2] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:45.756614 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-9d104add-1ea7-4a09-8447-12dd384e18ad tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:45.758526 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-9d104add-1ea7-4a09-8447-12dd384e18ad tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:45.762246 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-9d104add-1ea7-4a09-8447-12dd384e18ad tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:45.762929 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-9d104add-1ea7-4a09-8447-12dd384e18ad tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:45.851538 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-f3d6b4fe-7eac-4e22-a9f8-916ad50a07bd tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.117938 Jul 05 13:03:45.855440 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 178/365] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jul 5 13:03:44 2022] POST /compute/v2.1/servers => generated 409 bytes in 1126 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 05 13:03:45.868938 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-e2669b9b-a7c1-439c-9c7d-16d6bb816c12 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:45.869582 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-e2669b9b-a7c1-439c-9c7d-16d6bb816c12 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 7b7f15b2-a00e-4172-983d-f2a80401953b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:46.063243 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-e2669b9b-a7c1-439c-9c7d-16d6bb816c12 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:46.090231 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-e2669b9b-a7c1-439c-9c7d-16d6bb816c12 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b" status: 200 len: 1245 microversion: 2.1 time: 0.226949 Jul 05 13:03:46.093093 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 179/366] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:45 2022] GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b => generated 1245 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:03:46.095777 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-9d104add-1ea7-4a09-8447-12dd384e18ad tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:46.108036 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-9d104add-1ea7-4a09-8447-12dd384e18ad tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2" status: 200 len: 1367 microversion: 2.1 time: 0.367017 Jul 05 13:03:46.108791 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-fe91e08d-b670-4a4c-ab37-450f80b274db req-1b1f2803-c8e2-422a-b78e-c993de60d97f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fce1b2d5-4167-4f64-9ea2-794a86830bd2", "name": "network-vif-plugged", "status": "completed", "tag": "8a5a6e9b-a8fd-4e32-a9e6-6141c6a65210"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:03:46.110622 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 188/367] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:45 2022] GET /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2 => generated 1367 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:03:46.174674 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-852495a2-80fa-4bb5-9cf6-35f3192461cb tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:46.175497 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-852495a2-80fa-4bb5-9cf6-35f3192461cb tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] [instance: 058a9566-8f0f-4920-b435-22ea5bee15e7] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:46.184897 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-fe91e08d-b670-4a4c-ab37-450f80b274db req-1b1f2803-c8e2-422a-b78e-c993de60d97f service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:46.185695 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-fe91e08d-b670-4a4c-ab37-450f80b274db req-1b1f2803-c8e2-422a-b78e-c993de60d97f service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:46.232217 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-fe91e08d-b670-4a4c-ab37-450f80b274db req-1b1f2803-c8e2-422a-b78e-c993de60d97f service nova] Creating event network-vif-plugged:8a5a6e9b-a8fd-4e32-a9e6-6141c6a65210 for instance fce1b2d5-4167-4f64-9ea2-794a86830bd2 on hv-cinder-79760 Jul 05 13:03:46.258189 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-fe91e08d-b670-4a4c-ab37-450f80b274db req-1b1f2803-c8e2-422a-b78e-c993de60d97f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162866 Jul 05 13:03:46.258965 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 180/368] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:03:46.320501 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-852495a2-80fa-4bb5-9cf6-35f3192461cb tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4a4bd26db664e44850f5ebccd838315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380379df1d7e4ebe90c75bcefecbc787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:46.339544 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-852495a2-80fa-4bb5-9cf6-35f3192461cb tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] 10.222.0.36 "GET /compute/v2.1/servers/058a9566-8f0f-4920-b435-22ea5bee15e7" status: 200 len: 1214 microversion: 2.1 time: 0.169608 Jul 05 13:03:46.342076 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 189/369] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:46 2022] GET /compute/v2.1/servers/058a9566-8f0f-4920-b435-22ea5bee15e7 => generated 1214 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:03:46.523890 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-afc38907-bb90-4c2b-b5b0-a6b0d88cba43 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:46.524962 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-afc38907-bb90-4c2b-b5b0-a6b0d88cba43 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:46.535645 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-afc38907-bb90-4c2b-b5b0-a6b0d88cba43 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:46.537153 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-afc38907-bb90-4c2b-b5b0-a6b0d88cba43 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:46.538208 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-afc38907-bb90-4c2b-b5b0-a6b0d88cba43 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:46.538855 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-afc38907-bb90-4c2b-b5b0-a6b0d88cba43 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:46.767261 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-afc38907-bb90-4c2b-b5b0-a6b0d88cba43 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:46.778760 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-afc38907-bb90-4c2b-b5b0-a6b0d88cba43 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:46.783097 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-afc38907-bb90-4c2b-b5b0-a6b0d88cba43 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:46.789543 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-afc38907-bb90-4c2b-b5b0-a6b0d88cba43 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1740 microversion: 2.20 time: 0.267446 Jul 05 13:03:46.802762 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 181/370] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:03:46 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1740 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:03:47.109422 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-7ba8f376-d451-4c55-9ee3-38a5396220c0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:47.110713 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-7ba8f376-d451-4c55-9ee3-38a5396220c0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 7b7f15b2-a00e-4172-983d-f2a80401953b] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:47.126402 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-fc147050-9463-4fc1-93b9-ac1133a05887 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:47.127012 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-fc147050-9463-4fc1-93b9-ac1133a05887 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: fce1b2d5-4167-4f64-9ea2-794a86830bd2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:47.134008 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-fc147050-9463-4fc1-93b9-ac1133a05887 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:47.134455 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-fc147050-9463-4fc1-93b9-ac1133a05887 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:47.135223 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-fc147050-9463-4fc1-93b9-ac1133a05887 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:47.135828 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-fc147050-9463-4fc1-93b9-ac1133a05887 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:47.203272 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-7ba8f376-d451-4c55-9ee3-38a5396220c0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:47.212662 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-7ba8f376-d451-4c55-9ee3-38a5396220c0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b" status: 200 len: 1245 microversion: 2.1 time: 0.107538 Jul 05 13:03:47.227902 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 190/371] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:47 2022] GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b => generated 1245 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:47.330766 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-fc147050-9463-4fc1-93b9-ac1133a05887 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:47.339495 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-fc147050-9463-4fc1-93b9-ac1133a05887 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2" status: 200 len: 1367 microversion: 2.1 time: 0.216864 Jul 05 13:03:47.340070 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 182/372] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:47 2022] GET /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2 => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:47.362462 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-973946bb-0691-414e-8463-576732dc2c0e tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:47.363091 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-973946bb-0691-414e-8463-576732dc2c0e tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] [instance: 058a9566-8f0f-4920-b435-22ea5bee15e7] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:47.372844 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-973946bb-0691-414e-8463-576732dc2c0e tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:47.376856 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-973946bb-0691-414e-8463-576732dc2c0e tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:47.376856 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-973946bb-0691-414e-8463-576732dc2c0e tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:47.377095 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-973946bb-0691-414e-8463-576732dc2c0e tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:47.467462 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-973946bb-0691-414e-8463-576732dc2c0e tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4a4bd26db664e44850f5ebccd838315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380379df1d7e4ebe90c75bcefecbc787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:47.477708 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-973946bb-0691-414e-8463-576732dc2c0e tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] 10.222.0.36 "GET /compute/v2.1/servers/058a9566-8f0f-4920-b435-22ea5bee15e7" status: 200 len: 1266 microversion: 2.1 time: 0.119211 Jul 05 13:03:47.478562 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 191/373] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:47 2022] GET /compute/v2.1/servers/058a9566-8f0f-4920-b435-22ea5bee15e7 => generated 1266 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:47.809032 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-30690ac7-ff0b-4d6a-931f-7cf7eafdedcb tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:47.810541 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-30690ac7-ff0b-4d6a-931f-7cf7eafdedcb tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:47.817352 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-30690ac7-ff0b-4d6a-931f-7cf7eafdedcb tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:47.817906 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-30690ac7-ff0b-4d6a-931f-7cf7eafdedcb tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:47.818968 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-30690ac7-ff0b-4d6a-931f-7cf7eafdedcb tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:47.820006 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-30690ac7-ff0b-4d6a-931f-7cf7eafdedcb tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:47.974539 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-30690ac7-ff0b-4d6a-931f-7cf7eafdedcb tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:47.983763 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-30690ac7-ff0b-4d6a-931f-7cf7eafdedcb tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:47.985732 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-30690ac7-ff0b-4d6a-931f-7cf7eafdedcb tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:47.987202 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-30690ac7-ff0b-4d6a-931f-7cf7eafdedcb tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1740 microversion: 2.20 time: 0.182183 Jul 05 13:03:47.987897 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 183/374] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:03:47 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1740 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:03:48.235236 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-cf278c1c-3a5d-40ee-bc6f-f9086ca3e882 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:48.235848 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-cf278c1c-3a5d-40ee-bc6f-f9086ca3e882 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 7b7f15b2-a00e-4172-983d-f2a80401953b] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:48.242580 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-cf278c1c-3a5d-40ee-bc6f-f9086ca3e882 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:48.243022 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-cf278c1c-3a5d-40ee-bc6f-f9086ca3e882 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:48.243773 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-cf278c1c-3a5d-40ee-bc6f-f9086ca3e882 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:48.244200 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-cf278c1c-3a5d-40ee-bc6f-f9086ca3e882 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:48.303698 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-cf278c1c-3a5d-40ee-bc6f-f9086ca3e882 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:48.312346 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-cf278c1c-3a5d-40ee-bc6f-f9086ca3e882 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b" status: 200 len: 1249 microversion: 2.1 time: 0.080949 Jul 05 13:03:48.313010 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 192/375] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:48 2022] GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b => generated 1249 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:48.356808 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-dda9096a-f94b-49d5-bb20-1f4e1d690a29 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:48.357415 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-dda9096a-f94b-49d5-bb20-1f4e1d690a29 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: fce1b2d5-4167-4f64-9ea2-794a86830bd2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:48.364431 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-dda9096a-f94b-49d5-bb20-1f4e1d690a29 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:48.364907 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-dda9096a-f94b-49d5-bb20-1f4e1d690a29 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:48.365662 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-dda9096a-f94b-49d5-bb20-1f4e1d690a29 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:48.366093 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-dda9096a-f94b-49d5-bb20-1f4e1d690a29 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:48.497100 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-dda9096a-f94b-49d5-bb20-1f4e1d690a29 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:48.499076 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-b0bbc538-6f17-4879-83f2-11f3c1044ae8 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:48.499715 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-b0bbc538-6f17-4879-83f2-11f3c1044ae8 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] [instance: 058a9566-8f0f-4920-b435-22ea5bee15e7] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:48.505658 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-dda9096a-f94b-49d5-bb20-1f4e1d690a29 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2" status: 200 len: 1367 microversion: 2.1 time: 0.152710 Jul 05 13:03:48.508317 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b0bbc538-6f17-4879-83f2-11f3c1044ae8 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:48.508439 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 184/376] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:48 2022] GET /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:48.508635 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b0bbc538-6f17-4879-83f2-11f3c1044ae8 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:48.508635 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b0bbc538-6f17-4879-83f2-11f3c1044ae8 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:48.508635 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b0bbc538-6f17-4879-83f2-11f3c1044ae8 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:48.570078 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-b0bbc538-6f17-4879-83f2-11f3c1044ae8 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4a4bd26db664e44850f5ebccd838315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380379df1d7e4ebe90c75bcefecbc787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:48.580437 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-b0bbc538-6f17-4879-83f2-11f3c1044ae8 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] 10.222.0.36 "GET /compute/v2.1/servers/058a9566-8f0f-4920-b435-22ea5bee15e7" status: 200 len: 1266 microversion: 2.1 time: 0.085159 Jul 05 13:03:48.581300 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 193/377] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:48 2022] GET /compute/v2.1/servers/058a9566-8f0f-4920-b435-22ea5bee15e7 => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:03:49.012972 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-97e4cebb-2c95-4195-908c-d14e9913ee09 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:49.013582 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-97e4cebb-2c95-4195-908c-d14e9913ee09 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:49.028117 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-97e4cebb-2c95-4195-908c-d14e9913ee09 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:49.028574 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-97e4cebb-2c95-4195-908c-d14e9913ee09 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:49.029385 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-97e4cebb-2c95-4195-908c-d14e9913ee09 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:49.029811 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-97e4cebb-2c95-4195-908c-d14e9913ee09 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:49.295935 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-97e4cebb-2c95-4195-908c-d14e9913ee09 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:49.315322 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-97e4cebb-2c95-4195-908c-d14e9913ee09 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:49.317762 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-97e4cebb-2c95-4195-908c-d14e9913ee09 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:49.319559 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-97e4cebb-2c95-4195-908c-d14e9913ee09 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1740 microversion: 2.20 time: 0.310252 Jul 05 13:03:49.332915 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 185/378] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:03:49 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1740 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:03:49.341040 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-e1c1db69-70ec-42da-a478-d8a0ae629eb1 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:49.341040 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-e1c1db69-70ec-42da-a478-d8a0ae629eb1 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 7b7f15b2-a00e-4172-983d-f2a80401953b] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:49.344920 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e1c1db69-70ec-42da-a478-d8a0ae629eb1 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:49.345369 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e1c1db69-70ec-42da-a478-d8a0ae629eb1 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:49.346141 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e1c1db69-70ec-42da-a478-d8a0ae629eb1 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:49.346580 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e1c1db69-70ec-42da-a478-d8a0ae629eb1 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:49.433126 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-e1c1db69-70ec-42da-a478-d8a0ae629eb1 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:49.443330 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-e1c1db69-70ec-42da-a478-d8a0ae629eb1 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b" status: 200 len: 1249 microversion: 2.1 time: 0.111960 Jul 05 13:03:49.443934 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 194/379] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:49 2022] GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b => generated 1249 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:49.523510 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-c17521b2-17ee-4b39-8eca-5deabd9a40f4 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:49.524126 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-c17521b2-17ee-4b39-8eca-5deabd9a40f4 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: fce1b2d5-4167-4f64-9ea2-794a86830bd2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:49.526722 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:03:49.532755 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c17521b2-17ee-4b39-8eca-5deabd9a40f4 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:49.533445 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c17521b2-17ee-4b39-8eca-5deabd9a40f4 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:49.534610 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c17521b2-17ee-4b39-8eca-5deabd9a40f4 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:49.535148 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c17521b2-17ee-4b39-8eca-5deabd9a40f4 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:49.569166 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-9e1f5ed7-b216-4805-b2a9-bebf396ff37d tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1843097510", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-162669083", "security_groups": [{"name": "tempest-secgroup-smoke-745581940"}], "networks": [{"uuid": "140dbec5-dc03-477e-85f2-4a2f17b9c719"}], "block_device_mapping_v2": [{"uuid": "241fc1ad-b763-48a7-83fb-f816166853d3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:03:49.726672 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-c17521b2-17ee-4b39-8eca-5deabd9a40f4 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:49.735688 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-c17521b2-17ee-4b39-8eca-5deabd9a40f4 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2" status: 200 len: 1557 microversion: 2.1 time: 0.216345 Jul 05 13:03:49.738400 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 186/380] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:49 2022] GET /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2 => generated 1557 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:49.741451 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-380fa898-0d88-419c-9129-11f154622507 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:49.752579 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-380fa898-0d88-419c-9129-11f154622507 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] [instance: 058a9566-8f0f-4920-b435-22ea5bee15e7] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:49.760099 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.network.neutron [None req-9e1f5ed7-b216-4805-b2a9-bebf396ff37d tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] validate_networks() for [('140dbec5-dc03-477e-85f2-4a2f17b9c719', None, None, None, None, None)] {{(pid=118386) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 13:03:49.778198 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-380fa898-0d88-419c-9129-11f154622507 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:49.778655 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-380fa898-0d88-419c-9129-11f154622507 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:49.779684 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-380fa898-0d88-419c-9129-11f154622507 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:49.780173 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-380fa898-0d88-419c-9129-11f154622507 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:49.918729 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-380fa898-0d88-419c-9129-11f154622507 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4a4bd26db664e44850f5ebccd838315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380379df1d7e4ebe90c75bcefecbc787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:49.930325 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-380fa898-0d88-419c-9129-11f154622507 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] 10.222.0.36 "GET /compute/v2.1/servers/058a9566-8f0f-4920-b435-22ea5bee15e7" status: 200 len: 1284 microversion: 2.1 time: 0.192529 Jul 05 13:03:49.940130 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 187/381] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:49 2022] GET /compute/v2.1/servers/058a9566-8f0f-4920-b435-22ea5bee15e7 => generated 1284 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:49.944983 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-eb704322-e13b-4dea-a668-47fa6bf5bf66 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:49.945362 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-eb704322-e13b-4dea-a668-47fa6bf5bf66 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: fce1b2d5-4167-4f64-9ea2-794a86830bd2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:49.959547 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-eb704322-e13b-4dea-a668-47fa6bf5bf66 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:49.960082 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-eb704322-e13b-4dea-a668-47fa6bf5bf66 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:49.961062 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-eb704322-e13b-4dea-a668-47fa6bf5bf66 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:49.961384 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-eb704322-e13b-4dea-a668-47fa6bf5bf66 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:50.072571 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-eb704322-e13b-4dea-a668-47fa6bf5bf66 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.128378 Jul 05 13:03:50.072571 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 188/382] 10.222.0.36 () {58 vars in 1274 bytes} [Tue Jul 5 13:03:49 2022] GET /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2/os-interface => generated 284 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:03:50.340358 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-f769e73a-7383-44f5-99c7-e20fedb76f2d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:50.342648 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-f769e73a-7383-44f5-99c7-e20fedb76f2d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:50.348753 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f769e73a-7383-44f5-99c7-e20fedb76f2d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:50.349312 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f769e73a-7383-44f5-99c7-e20fedb76f2d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:50.350213 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f769e73a-7383-44f5-99c7-e20fedb76f2d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:50.350746 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f769e73a-7383-44f5-99c7-e20fedb76f2d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:51.039892 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.virt.hardware [None req-9e1f5ed7-b216-4805-b2a9-bebf396ff37d tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Flavor limits 0:0:0 {{(pid=118386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 13:03:51.040975 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.virt.hardware [None req-9e1f5ed7-b216-4805-b2a9-bebf396ff37d tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Image limits 0:0:0 {{(pid=118386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 13:03:51.042909 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.virt.hardware [None req-9e1f5ed7-b216-4805-b2a9-bebf396ff37d tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Flavor pref 0:0:0 {{(pid=118386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 13:03:51.043487 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.virt.hardware [None req-9e1f5ed7-b216-4805-b2a9-bebf396ff37d tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Image pref 0:0:0 {{(pid=118386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 13:03:51.044063 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.virt.hardware [None req-9e1f5ed7-b216-4805-b2a9-bebf396ff37d tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 13:03:51.051966 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-f769e73a-7383-44f5-99c7-e20fedb76f2d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:51.056757 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-9e1f5ed7-b216-4805-b2a9-bebf396ff37d tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:51.057564 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-9e1f5ed7-b216-4805-b2a9-bebf396ff37d tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:51.061306 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-f769e73a-7383-44f5-99c7-e20fedb76f2d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:51.063964 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-f769e73a-7383-44f5-99c7-e20fedb76f2d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:51.069028 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-f769e73a-7383-44f5-99c7-e20fedb76f2d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1740 microversion: 2.20 time: 0.733079 Jul 05 13:03:51.069563 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 189/383] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:03:50 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1740 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:03:51.074079 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-4db46119-7670-4b0b-875c-d9966d7870b0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:51.075594 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-9e1f5ed7-b216-4805-b2a9-bebf396ff37d tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:51.078926 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-4db46119-7670-4b0b-875c-d9966d7870b0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 7b7f15b2-a00e-4172-983d-f2a80401953b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:51.080064 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-9e1f5ed7-b216-4805-b2a9-bebf396ff37d tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:51.095398 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4db46119-7670-4b0b-875c-d9966d7870b0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:51.098650 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4db46119-7670-4b0b-875c-d9966d7870b0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:51.099519 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4db46119-7670-4b0b-875c-d9966d7870b0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:51.102229 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4db46119-7670-4b0b-875c-d9966d7870b0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:51.105523 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.quota [None req-9e1f5ed7-b216-4805-b2a9-bebf396ff37d tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Getting quotas for project ec699c3dd1ab470c8cc0685e6e9f766a. Resources: {'instances', 'cores', 'ram'} {{(pid=118386) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 13:03:51.107197 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.quota [None req-9e1f5ed7-b216-4805-b2a9-bebf396ff37d tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Getting quotas for user 4cf000835f1f48cca0a46b233e52c8b9 and project ec699c3dd1ab470c8cc0685e6e9f766a. Resources: {'instances', 'cores', 'ram'} {{(pid=118386) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 13:03:51.141701 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell1:SELECT=100 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:03:51.168691 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-9e1f5ed7-b216-4805-b2a9-bebf396ff37d tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Going to run 1 instances... {{(pid=118386) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 13:03:51.171021 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-9e1f5ed7-b216-4805-b2a9-bebf396ff37d tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] [instance: 58708391-4350-4b7e-8616-f3f3534bd2e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='241fc1ad-b763-48a7-83fb-f816166853d3',volume_size=None,volume_type=None)] {{(pid=118386) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 13:03:51.241207 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-4db46119-7670-4b0b-875c-d9966d7870b0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:51.253031 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-4db46119-7670-4b0b-875c-d9966d7870b0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b" status: 200 len: 1305 microversion: 2.1 time: 0.181723 Jul 05 13:03:51.255070 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 190/384] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:51 2022] GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b => generated 1305 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:51.261439 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-99bd4278-ce93-425f-be84-ab413c87c780 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:51.262917 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-99bd4278-ce93-425f-be84-ab413c87c780 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] [instance: 058a9566-8f0f-4920-b435-22ea5bee15e7] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:51.269945 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-99bd4278-ce93-425f-be84-ab413c87c780 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:51.270397 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-99bd4278-ce93-425f-be84-ab413c87c780 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:51.271172 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-99bd4278-ce93-425f-be84-ab413c87c780 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:51.271980 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-99bd4278-ce93-425f-be84-ab413c87c780 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:51.602961 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-9e1f5ed7-b216-4805-b2a9-bebf396ff37d tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.038244 Jul 05 13:03:51.603633 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-99bd4278-ce93-425f-be84-ab413c87c780 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4a4bd26db664e44850f5ebccd838315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380379df1d7e4ebe90c75bcefecbc787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:51.604734 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 195/385] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jul 5 13:03:49 2022] POST /compute/v2.1/servers => generated 405 bytes in 2040 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 05 13:03:51.615534 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-99bd4278-ce93-425f-be84-ab413c87c780 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] 10.222.0.36 "GET /compute/v2.1/servers/058a9566-8f0f-4920-b435-22ea5bee15e7" status: 200 len: 1314 microversion: 2.1 time: 0.357978 Jul 05 13:03:51.616644 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 191/386] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:51 2022] GET /compute/v2.1/servers/058a9566-8f0f-4920-b435-22ea5bee15e7 => generated 1314 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:51.617526 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-59fb099d-ab13-4312-ab98-3e84beb3a2e4 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:51.618144 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-59fb099d-ab13-4312-ab98-3e84beb3a2e4 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] [instance: 58708391-4350-4b7e-8616-f3f3534bd2e6] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:51.732240 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-59fb099d-ab13-4312-ab98-3e84beb3a2e4 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf000835f1f48cca0a46b233e52c8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec699c3dd1ab470c8cc0685e6e9f766a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:51.736689 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-59fb099d-ab13-4312-ab98-3e84beb3a2e4 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] 10.222.0.36 "GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6" status: 200 len: 1088 microversion: 2.1 time: 0.126013 Jul 05 13:03:51.749009 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 196/387] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:51 2022] GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6 => generated 1088 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:52.093464 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-f2af7aa9-eee5-4a43-81d3-5eba5a222b62 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:52.094946 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-f2af7aa9-eee5-4a43-81d3-5eba5a222b62 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:52.112092 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f2af7aa9-eee5-4a43-81d3-5eba5a222b62 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:52.112863 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f2af7aa9-eee5-4a43-81d3-5eba5a222b62 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:52.114416 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f2af7aa9-eee5-4a43-81d3-5eba5a222b62 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:52.115021 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f2af7aa9-eee5-4a43-81d3-5eba5a222b62 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:52.115780 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [req-7147e678-3cc0-457a-8b94-0f681dab61bb req-67fb5709-ad19-4d19-941b-0b963d2e8253 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fce1b2d5-4167-4f64-9ea2-794a86830bd2", "tag": "8a5a6e9b-a8fd-4e32-a9e6-6141c6a65210"}]} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:03:52.131614 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-7147e678-3cc0-457a-8b94-0f681dab61bb req-67fb5709-ad19-4d19-941b-0b963d2e8253 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:52.133937 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-7147e678-3cc0-457a-8b94-0f681dab61bb req-67fb5709-ad19-4d19-941b-0b963d2e8253 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:52.155767 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.compute.server_external_events [req-7147e678-3cc0-457a-8b94-0f681dab61bb req-67fb5709-ad19-4d19-941b-0b963d2e8253 service nova] Creating event network-changed:8a5a6e9b-a8fd-4e32-a9e6-6141c6a65210 for instance fce1b2d5-4167-4f64-9ea2-794a86830bd2 on hv-cinder-79760 Jul 05 13:03:52.167720 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [req-7147e678-3cc0-457a-8b94-0f681dab61bb req-67fb5709-ad19-4d19-941b-0b963d2e8253 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056917 Jul 05 13:03:52.184132 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 197/388] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:03:52.273180 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-cfda5b8c-a251-442d-a3db-467595bdabae tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:52.273884 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-cfda5b8c-a251-442d-a3db-467595bdabae tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 7b7f15b2-a00e-4172-983d-f2a80401953b] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:52.284291 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-cfda5b8c-a251-442d-a3db-467595bdabae tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:52.285722 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-cfda5b8c-a251-442d-a3db-467595bdabae tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:52.286517 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-cfda5b8c-a251-442d-a3db-467595bdabae tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:52.288799 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-cfda5b8c-a251-442d-a3db-467595bdabae tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:52.338267 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-f2af7aa9-eee5-4a43-81d3-5eba5a222b62 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:52.346536 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-f2af7aa9-eee5-4a43-81d3-5eba5a222b62 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:52.348064 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-f2af7aa9-eee5-4a43-81d3-5eba5a222b62 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:52.349268 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-f2af7aa9-eee5-4a43-81d3-5eba5a222b62 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1722 microversion: 2.20 time: 0.266091 Jul 05 13:03:52.367801 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 192/389] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:03:52 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1722 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:03:52.405833 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-cfda5b8c-a251-442d-a3db-467595bdabae tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:52.416021 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-cfda5b8c-a251-442d-a3db-467595bdabae tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b" status: 200 len: 1303 microversion: 2.1 time: 0.148385 Jul 05 13:03:52.419033 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 198/390] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:52 2022] GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b => generated 1303 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:52.633384 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-ed180073-bfbf-4589-8da5-08bd771405aa tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:52.645856 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-ed180073-bfbf-4589-8da5-08bd771405aa tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] [instance: 058a9566-8f0f-4920-b435-22ea5bee15e7] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:52.645856 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ed180073-bfbf-4589-8da5-08bd771405aa tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:52.647927 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ed180073-bfbf-4589-8da5-08bd771405aa tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:52.648870 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ed180073-bfbf-4589-8da5-08bd771405aa tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:52.649434 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ed180073-bfbf-4589-8da5-08bd771405aa tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:52.756141 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-7739f669-2516-4211-a329-d149749bebaa tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:52.756799 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-7739f669-2516-4211-a329-d149749bebaa tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] [instance: 58708391-4350-4b7e-8616-f3f3534bd2e6] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:52.884921 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-7739f669-2516-4211-a329-d149749bebaa tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf000835f1f48cca0a46b233e52c8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec699c3dd1ab470c8cc0685e6e9f766a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:52.892077 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-7739f669-2516-4211-a329-d149749bebaa tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] 10.222.0.36 "GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6" status: 200 len: 1088 microversion: 2.1 time: 0.140386 Jul 05 13:03:52.892677 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 199/391] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:52 2022] GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6 => generated 1088 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:52.972166 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-ed180073-bfbf-4589-8da5-08bd771405aa tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4a4bd26db664e44850f5ebccd838315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380379df1d7e4ebe90c75bcefecbc787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:52.981627 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-ed180073-bfbf-4589-8da5-08bd771405aa tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] 10.222.0.36 "GET /compute/v2.1/servers/058a9566-8f0f-4920-b435-22ea5bee15e7" status: 200 len: 1314 microversion: 2.1 time: 0.352794 Jul 05 13:03:52.989454 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 193/392] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:52 2022] GET /compute/v2.1/servers/058a9566-8f0f-4920-b435-22ea5bee15e7 => generated 1314 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:53.131883 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [req-2b1a5d86-6aa1-4f6c-8a63-3b9b945ae478 req-872516b6-74b8-429f-859d-447df0aa1aa0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "058a9566-8f0f-4920-b435-22ea5bee15e7", "tag": "e7af3335-2286-40b5-bde4-70b80fbc82bd"}]} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:03:53.146517 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-2b1a5d86-6aa1-4f6c-8a63-3b9b945ae478 req-872516b6-74b8-429f-859d-447df0aa1aa0 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:53.146850 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-2b1a5d86-6aa1-4f6c-8a63-3b9b945ae478 req-872516b6-74b8-429f-859d-447df0aa1aa0 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:53.191124 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.compute.server_external_events [req-2b1a5d86-6aa1-4f6c-8a63-3b9b945ae478 req-872516b6-74b8-429f-859d-447df0aa1aa0 service nova] Creating event network-changed:e7af3335-2286-40b5-bde4-70b80fbc82bd for instance 058a9566-8f0f-4920-b435-22ea5bee15e7 on hv-cinder-79760 Jul 05 13:03:53.199813 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [req-2b1a5d86-6aa1-4f6c-8a63-3b9b945ae478 req-872516b6-74b8-429f-859d-447df0aa1aa0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074801 Jul 05 13:03:53.201067 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 200/393] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:03:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:03:53.375239 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-4cffdef4-6f14-46a1-870a-4bd3a1a90cb7 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:53.376486 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-4cffdef4-6f14-46a1-870a-4bd3a1a90cb7 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:53.385745 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4cffdef4-6f14-46a1-870a-4bd3a1a90cb7 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:53.388269 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4cffdef4-6f14-46a1-870a-4bd3a1a90cb7 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:53.388269 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4cffdef4-6f14-46a1-870a-4bd3a1a90cb7 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:53.388269 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4cffdef4-6f14-46a1-870a-4bd3a1a90cb7 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:53.438492 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-b0d94ee5-e126-4d29-bd54-c3c143e092d5 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:53.439286 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-b0d94ee5-e126-4d29-bd54-c3c143e092d5 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 7b7f15b2-a00e-4172-983d-f2a80401953b] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:53.451336 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b0d94ee5-e126-4d29-bd54-c3c143e092d5 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:53.451336 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b0d94ee5-e126-4d29-bd54-c3c143e092d5 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:53.451336 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b0d94ee5-e126-4d29-bd54-c3c143e092d5 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:53.451336 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b0d94ee5-e126-4d29-bd54-c3c143e092d5 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:53.665850 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-4cffdef4-6f14-46a1-870a-4bd3a1a90cb7 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:53.680639 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-4cffdef4-6f14-46a1-870a-4bd3a1a90cb7 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:53.684254 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-4cffdef4-6f14-46a1-870a-4bd3a1a90cb7 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:53.685499 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-4cffdef4-6f14-46a1-870a-4bd3a1a90cb7 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1722 microversion: 2.20 time: 0.314167 Jul 05 13:03:53.689959 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 194/394] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:03:53 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1722 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:03:53.738090 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-b0d94ee5-e126-4d29-bd54-c3c143e092d5 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:53.746779 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-b0d94ee5-e126-4d29-bd54-c3c143e092d5 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b" status: 200 len: 1371 microversion: 2.1 time: 0.312410 Jul 05 13:03:53.756949 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 201/395] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:53 2022] GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b => generated 1371 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:53.818018 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-51e25b77-8e84-45f8-b8f8-2ce676d3158b req-17fdefa1-56ee-4671-80b1-d88dc1693090 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72285b0b-7735-422b-b110-ef7b03fb367f", "name": "network-vif-unplugged", "status": "completed", "tag": "caf3b4b2-126a-423d-b8ca-4680670bb511"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:03:53.826415 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-51e25b77-8e84-45f8-b8f8-2ce676d3158b req-17fdefa1-56ee-4671-80b1-d88dc1693090 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:53.826864 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-51e25b77-8e84-45f8-b8f8-2ce676d3158b req-17fdefa1-56ee-4671-80b1-d88dc1693090 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:53.839603 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-51e25b77-8e84-45f8-b8f8-2ce676d3158b req-17fdefa1-56ee-4671-80b1-d88dc1693090 service nova] Creating event network-vif-unplugged:caf3b4b2-126a-423d-b8ca-4680670bb511 for instance 72285b0b-7735-422b-b110-ef7b03fb367f on hv-cinder-79760 Jul 05 13:03:53.844967 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-51e25b77-8e84-45f8-b8f8-2ce676d3158b req-17fdefa1-56ee-4671-80b1-d88dc1693090 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040654 Jul 05 13:03:53.845614 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 195/396] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:03:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:03:53.912658 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-fe9d7568-ea6e-4996-a132-07323c7e5d70 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:53.912658 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-fe9d7568-ea6e-4996-a132-07323c7e5d70 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] [instance: 58708391-4350-4b7e-8616-f3f3534bd2e6] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:53.917799 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-fe9d7568-ea6e-4996-a132-07323c7e5d70 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:53.918827 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-fe9d7568-ea6e-4996-a132-07323c7e5d70 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:53.920268 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-fe9d7568-ea6e-4996-a132-07323c7e5d70 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:53.920721 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-fe9d7568-ea6e-4996-a132-07323c7e5d70 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:53.936158 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_cell1:SELECT=100 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:03:54.001006 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-aa131b14-9e23-4ca0-be70-b19c237c5ac8 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:54.001006 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-aa131b14-9e23-4ca0-be70-b19c237c5ac8 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] [instance: 058a9566-8f0f-4920-b435-22ea5bee15e7] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:54.007777 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-aa131b14-9e23-4ca0-be70-b19c237c5ac8 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:54.008223 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-aa131b14-9e23-4ca0-be70-b19c237c5ac8 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:54.009027 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-aa131b14-9e23-4ca0-be70-b19c237c5ac8 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:54.009499 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-aa131b14-9e23-4ca0-be70-b19c237c5ac8 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:54.044624 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-fe9d7568-ea6e-4996-a132-07323c7e5d70 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf000835f1f48cca0a46b233e52c8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec699c3dd1ab470c8cc0685e6e9f766a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:54.053392 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-fe9d7568-ea6e-4996-a132-07323c7e5d70 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] 10.222.0.36 "GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6" status: 200 len: 1138 microversion: 2.1 time: 0.147627 Jul 05 13:03:54.062984 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 202/397] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:53 2022] GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6 => generated 1138 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:54.164381 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-aa131b14-9e23-4ca0-be70-b19c237c5ac8 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4a4bd26db664e44850f5ebccd838315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380379df1d7e4ebe90c75bcefecbc787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:54.171789 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-aa131b14-9e23-4ca0-be70-b19c237c5ac8 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] 10.222.0.36 "GET /compute/v2.1/servers/058a9566-8f0f-4920-b435-22ea5bee15e7" status: 200 len: 1314 microversion: 2.1 time: 0.176202 Jul 05 13:03:54.178182 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 196/398] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:53 2022] GET /compute/v2.1/servers/058a9566-8f0f-4920-b435-22ea5bee15e7 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:54.722167 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-0aa72807-f76c-46b6-aeff-8c06d607adf8 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:54.724970 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-0aa72807-f76c-46b6-aeff-8c06d607adf8 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:54.747972 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-0aa72807-f76c-46b6-aeff-8c06d607adf8 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:54.748662 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-0aa72807-f76c-46b6-aeff-8c06d607adf8 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:54.749686 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-0aa72807-f76c-46b6-aeff-8c06d607adf8 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:54.750298 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-0aa72807-f76c-46b6-aeff-8c06d607adf8 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:54.764776 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-0fcf4e6b-29f1-4aff-abc2-19b6d4225b29 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:54.766449 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-0fcf4e6b-29f1-4aff-abc2-19b6d4225b29 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 7b7f15b2-a00e-4172-983d-f2a80401953b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:54.778071 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0fcf4e6b-29f1-4aff-abc2-19b6d4225b29 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:54.778715 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0fcf4e6b-29f1-4aff-abc2-19b6d4225b29 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:54.779970 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0fcf4e6b-29f1-4aff-abc2-19b6d4225b29 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:54.780568 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0fcf4e6b-29f1-4aff-abc2-19b6d4225b29 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:55.000998 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-0aa72807-f76c-46b6-aeff-8c06d607adf8 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:55.023639 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-0aa72807-f76c-46b6-aeff-8c06d607adf8 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:55.027687 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-0aa72807-f76c-46b6-aeff-8c06d607adf8 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:55.032457 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-0fcf4e6b-29f1-4aff-abc2-19b6d4225b29 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:55.032802 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-0aa72807-f76c-46b6-aeff-8c06d607adf8 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1722 microversion: 2.20 time: 0.329210 Jul 05 13:03:55.033350 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 203/399] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:03:54 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1722 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:03:55.037726 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-0fcf4e6b-29f1-4aff-abc2-19b6d4225b29 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b" status: 200 len: 1371 microversion: 2.1 time: 0.277467 Jul 05 13:03:55.048109 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 197/400] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:54 2022] GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b => generated 1371 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:03:55.070695 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-8d14d884-0d46-4123-81e4-653d73e1e5ab tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:55.071433 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-8d14d884-0d46-4123-81e4-653d73e1e5ab tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] [instance: 58708391-4350-4b7e-8616-f3f3534bd2e6] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:55.078279 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-8d14d884-0d46-4123-81e4-653d73e1e5ab tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:55.078856 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-8d14d884-0d46-4123-81e4-653d73e1e5ab tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:55.079730 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-8d14d884-0d46-4123-81e4-653d73e1e5ab tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:55.080295 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-8d14d884-0d46-4123-81e4-653d73e1e5ab tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:55.163412 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-8d14d884-0d46-4123-81e4-653d73e1e5ab tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf000835f1f48cca0a46b233e52c8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec699c3dd1ab470c8cc0685e6e9f766a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:55.172060 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-8d14d884-0d46-4123-81e4-653d73e1e5ab tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] 10.222.0.36 "GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6" status: 200 len: 1130 microversion: 2.1 time: 0.105788 Jul 05 13:03:55.172951 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 204/401] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:55 2022] GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6 => generated 1130 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:55.190400 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-8e5b0363-0afe-4a9d-9cc8-1c76de25320e tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:55.191343 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-8e5b0363-0afe-4a9d-9cc8-1c76de25320e tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] [instance: 058a9566-8f0f-4920-b435-22ea5bee15e7] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:55.198658 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8e5b0363-0afe-4a9d-9cc8-1c76de25320e tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:55.199287 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8e5b0363-0afe-4a9d-9cc8-1c76de25320e tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:55.200240 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8e5b0363-0afe-4a9d-9cc8-1c76de25320e tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:55.200849 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8e5b0363-0afe-4a9d-9cc8-1c76de25320e tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:55.371084 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-8e5b0363-0afe-4a9d-9cc8-1c76de25320e tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4a4bd26db664e44850f5ebccd838315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380379df1d7e4ebe90c75bcefecbc787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:55.379115 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-8e5b0363-0afe-4a9d-9cc8-1c76de25320e tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] 10.222.0.36 "GET /compute/v2.1/servers/058a9566-8f0f-4920-b435-22ea5bee15e7" status: 200 len: 1314 microversion: 2.1 time: 0.192485 Jul 05 13:03:55.379711 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 198/402] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:55 2022] GET /compute/v2.1/servers/058a9566-8f0f-4920-b435-22ea5bee15e7 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:56.051866 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-80aa4bb4-313d-4371-ab08-5d0c71966e4a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:56.052507 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-80aa4bb4-313d-4371-ab08-5d0c71966e4a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:56.068359 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-58bab966-cee6-43d2-9a63-371ea89f6fde tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:56.069091 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-58bab966-cee6-43d2-9a63-371ea89f6fde tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 7b7f15b2-a00e-4172-983d-f2a80401953b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:56.071899 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell0:SELECT=2 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:03:56.073083 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell0:SELECT=12 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:03:56.078965 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-80aa4bb4-313d-4371-ab08-5d0c71966e4a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:56.081147 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-80aa4bb4-313d-4371-ab08-5d0c71966e4a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:56.082728 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-80aa4bb4-313d-4371-ab08-5d0c71966e4a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:56.084662 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-58bab966-cee6-43d2-9a63-371ea89f6fde tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:56.085421 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-80aa4bb4-313d-4371-ab08-5d0c71966e4a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:56.088965 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-58bab966-cee6-43d2-9a63-371ea89f6fde tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:56.090022 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-58bab966-cee6-43d2-9a63-371ea89f6fde tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:56.090909 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-58bab966-cee6-43d2-9a63-371ea89f6fde tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:56.351497 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-58bab966-cee6-43d2-9a63-371ea89f6fde tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:56.363148 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-58bab966-cee6-43d2-9a63-371ea89f6fde tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b" status: 200 len: 1371 microversion: 2.1 time: 0.307755 Jul 05 13:03:56.364517 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-80aa4bb4-313d-4371-ab08-5d0c71966e4a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:56.365003 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 199/403] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:56 2022] GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b => generated 1371 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:56.373417 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-80aa4bb4-313d-4371-ab08-5d0c71966e4a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:56.375017 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-80aa4bb4-313d-4371-ab08-5d0c71966e4a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:56.376320 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-80aa4bb4-313d-4371-ab08-5d0c71966e4a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1725 microversion: 2.20 time: 0.328879 Jul 05 13:03:56.376754 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 205/404] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:03:56 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1725 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:03:56.381668 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-1019ec04-cfb4-4f6a-8769-171da229d9f9 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:56.382971 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-1019ec04-cfb4-4f6a-8769-171da229d9f9 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] [instance: 58708391-4350-4b7e-8616-f3f3534bd2e6] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:56.388908 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1019ec04-cfb4-4f6a-8769-171da229d9f9 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:56.389718 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1019ec04-cfb4-4f6a-8769-171da229d9f9 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:56.395355 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-b1a5b230-0b97-44a2-a42c-09e5859158fb tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:56.395977 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-b1a5b230-0b97-44a2-a42c-09e5859158fb tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] [instance: 058a9566-8f0f-4920-b435-22ea5bee15e7] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:56.397159 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1019ec04-cfb4-4f6a-8769-171da229d9f9 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:56.397836 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1019ec04-cfb4-4f6a-8769-171da229d9f9 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:56.402528 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b1a5b230-0b97-44a2-a42c-09e5859158fb tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:56.402977 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b1a5b230-0b97-44a2-a42c-09e5859158fb tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:56.403792 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b1a5b230-0b97-44a2-a42c-09e5859158fb tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:56.404243 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b1a5b230-0b97-44a2-a42c-09e5859158fb tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:56.504728 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-1019ec04-cfb4-4f6a-8769-171da229d9f9 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf000835f1f48cca0a46b233e52c8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec699c3dd1ab470c8cc0685e6e9f766a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:56.513547 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-1019ec04-cfb4-4f6a-8769-171da229d9f9 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] 10.222.0.36 "GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6" status: 200 len: 1204 microversion: 2.1 time: 0.147117 Jul 05 13:03:56.513911 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 200/405] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:56 2022] GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6 => generated 1204 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:56.520059 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-10de7947-620f-48d3-a0ac-d8a78ec5e011 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2b46f9b1-8f44-45c1-9fa3-dedee47c1247"}} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:03:56.521146 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-10de7947-620f-48d3-a0ac-d8a78ec5e011 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:56.543233 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-10de7947-620f-48d3-a0ac-d8a78ec5e011 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:56.544865 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-10de7947-620f-48d3-a0ac-d8a78ec5e011 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:56.545719 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-10de7947-620f-48d3-a0ac-d8a78ec5e011 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:56.546117 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-10de7947-620f-48d3-a0ac-d8a78ec5e011 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:56.730652 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-b1a5b230-0b97-44a2-a42c-09e5859158fb tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4a4bd26db664e44850f5ebccd838315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380379df1d7e4ebe90c75bcefecbc787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:56.740058 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-b1a5b230-0b97-44a2-a42c-09e5859158fb tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] 10.222.0.36 "GET /compute/v2.1/servers/058a9566-8f0f-4920-b435-22ea5bee15e7" status: 200 len: 1314 microversion: 2.1 time: 0.348514 Jul 05 13:03:56.741249 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 206/406] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:56 2022] GET /compute/v2.1/servers/058a9566-8f0f-4920-b435-22ea5bee15e7 => generated 1314 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:03:56.747464 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [req-daec250c-ca92-4d9a-9a08-430e7952e092 req-7223b441-8cca-4480-b385-4625ac8e1256 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b7f15b2-a00e-4172-983d-f2a80401953b", "tag": "31d1ed43-9fb9-4a56-aa9d-2fb0657cefdc"}]} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:03:56.756429 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-daec250c-ca92-4d9a-9a08-430e7952e092 req-7223b441-8cca-4480-b385-4625ac8e1256 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:56.756870 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-daec250c-ca92-4d9a-9a08-430e7952e092 req-7223b441-8cca-4480-b385-4625ac8e1256 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:56.771601 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.compute.server_external_events [req-daec250c-ca92-4d9a-9a08-430e7952e092 req-7223b441-8cca-4480-b385-4625ac8e1256 service nova] Creating event network-changed:31d1ed43-9fb9-4a56-aa9d-2fb0657cefdc for instance 7b7f15b2-a00e-4172-983d-f2a80401953b on hv-cinder-79760 Jul 05 13:03:56.780726 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [req-daec250c-ca92-4d9a-9a08-430e7952e092 req-7223b441-8cca-4480-b385-4625ac8e1256 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037982 Jul 05 13:03:56.781611 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 207/407] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:03:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:03:57.381466 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-da65f766-9f00-44fc-bc04-f99937639b81 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:57.382296 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-da65f766-9f00-44fc-bc04-f99937639b81 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 7b7f15b2-a00e-4172-983d-f2a80401953b] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:57.389121 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-da65f766-9f00-44fc-bc04-f99937639b81 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:57.389662 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-da65f766-9f00-44fc-bc04-f99937639b81 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:57.390436 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-da65f766-9f00-44fc-bc04-f99937639b81 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:57.390863 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-da65f766-9f00-44fc-bc04-f99937639b81 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:57.542889 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-da65f766-9f00-44fc-bc04-f99937639b81 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:57.554373 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-da65f766-9f00-44fc-bc04-f99937639b81 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b" status: 200 len: 1371 microversion: 2.1 time: 0.177090 Jul 05 13:03:57.555100 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 208/408] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:57 2022] GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b => generated 1371 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:03:57.562704 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-a4f60022-6e99-44d0-8360-f3ea6082bb87 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:57.562704 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-a4f60022-6e99-44d0-8360-f3ea6082bb87 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] [instance: 58708391-4350-4b7e-8616-f3f3534bd2e6] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:57.567903 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a4f60022-6e99-44d0-8360-f3ea6082bb87 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:57.568542 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a4f60022-6e99-44d0-8360-f3ea6082bb87 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:57.569433 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a4f60022-6e99-44d0-8360-f3ea6082bb87 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:57.570000 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a4f60022-6e99-44d0-8360-f3ea6082bb87 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:57.752127 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-a4f60022-6e99-44d0-8360-f3ea6082bb87 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf000835f1f48cca0a46b233e52c8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec699c3dd1ab470c8cc0685e6e9f766a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:57.761478 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-a4f60022-6e99-44d0-8360-f3ea6082bb87 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] 10.222.0.36 "GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6" status: 200 len: 1271 microversion: 2.1 time: 0.205283 Jul 05 13:03:57.762324 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 209/409] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:57 2022] GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6 => generated 1271 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:57.767495 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-4cc796c7-045f-4564-8896-5933d7c51b30 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:57.768105 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-4cc796c7-045f-4564-8896-5933d7c51b30 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] [instance: 058a9566-8f0f-4920-b435-22ea5bee15e7] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:57.780522 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-4cc796c7-045f-4564-8896-5933d7c51b30 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:57.780995 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-4cc796c7-045f-4564-8896-5933d7c51b30 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:57.781761 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-4cc796c7-045f-4564-8896-5933d7c51b30 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:57.782415 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-4cc796c7-045f-4564-8896-5933d7c51b30 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:57.924823 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-4cc796c7-045f-4564-8896-5933d7c51b30 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4a4bd26db664e44850f5ebccd838315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380379df1d7e4ebe90c75bcefecbc787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:57.932465 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-4cc796c7-045f-4564-8896-5933d7c51b30 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] 10.222.0.36 "GET /compute/v2.1/servers/058a9566-8f0f-4920-b435-22ea5bee15e7" status: 200 len: 1314 microversion: 2.1 time: 0.169038 Jul 05 13:03:57.933137 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 210/410] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:57 2022] GET /compute/v2.1/servers/058a9566-8f0f-4920-b435-22ea5bee15e7 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:58.345035 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-10de7947-620f-48d3-a0ac-d8a78ec5e011 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "POST /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.829469 Jul 05 13:03:58.351003 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 201/411] 10.222.0.36 () {62 vars in 1363 bytes} [Tue Jul 5 13:03:56 2022] POST /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f/os-volume_attachments => generated 188 bytes in 1831 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 13:03:58.464032 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-bd716e88-c0f4-4b75-a580-458f92dba744 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:03:58.464770 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-bd716e88-c0f4-4b75-a580-458f92dba744 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:58.471509 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-bd716e88-c0f4-4b75-a580-458f92dba744 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:58.472089 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-bd716e88-c0f4-4b75-a580-458f92dba744 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:58.473538 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-bd716e88-c0f4-4b75-a580-458f92dba744 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:58.474036 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-bd716e88-c0f4-4b75-a580-458f92dba744 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:58.515439 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:03:58.574274 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-b522270c-06ae-457f-8a02-6f2f140f9c06 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:58.575948 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-b522270c-06ae-457f-8a02-6f2f140f9c06 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 7b7f15b2-a00e-4172-983d-f2a80401953b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:58.587410 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b522270c-06ae-457f-8a02-6f2f140f9c06 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:58.588608 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b522270c-06ae-457f-8a02-6f2f140f9c06 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:58.589616 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b522270c-06ae-457f-8a02-6f2f140f9c06 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:58.590226 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b522270c-06ae-457f-8a02-6f2f140f9c06 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:58.714463 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-bd716e88-c0f4-4b75-a580-458f92dba744 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "POST /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f/action" status: 202 len: 0 microversion: 2.20 time: 0.254341 Jul 05 13:03:58.715475 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 211/412] 10.222.0.36 () {62 vars in 1318 bytes} [Tue Jul 5 13:03:58 2022] POST /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 05 13:03:58.724527 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-c92ac254-4161-4802-9dba-de101e5f379b tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:58.725636 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-c92ac254-4161-4802-9dba-de101e5f379b tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:58.734188 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-c92ac254-4161-4802-9dba-de101e5f379b tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:58.734704 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-c92ac254-4161-4802-9dba-de101e5f379b tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:58.735545 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-c92ac254-4161-4802-9dba-de101e5f379b tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:58.736183 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-c92ac254-4161-4802-9dba-de101e5f379b tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:58.862365 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-b522270c-06ae-457f-8a02-6f2f140f9c06 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:58.873122 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-b522270c-06ae-457f-8a02-6f2f140f9c06 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b" status: 200 len: 1371 microversion: 2.1 time: 0.305383 Jul 05 13:03:58.875026 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 202/413] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:58 2022] GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b => generated 1371 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:58.888877 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-8cae57b6-2a14-4b5d-9f63-67f4d9f410bd tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:58.891123 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-8cae57b6-2a14-4b5d-9f63-67f4d9f410bd tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] [instance: 58708391-4350-4b7e-8616-f3f3534bd2e6] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:58.898237 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8cae57b6-2a14-4b5d-9f63-67f4d9f410bd tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:58.899406 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8cae57b6-2a14-4b5d-9f63-67f4d9f410bd tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:58.900394 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8cae57b6-2a14-4b5d-9f63-67f4d9f410bd tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:58.901128 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8cae57b6-2a14-4b5d-9f63-67f4d9f410bd tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:59.016134 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-c92ac254-4161-4802-9dba-de101e5f379b tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:59.026354 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-c92ac254-4161-4802-9dba-de101e5f379b tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:59.027853 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-c92ac254-4161-4802-9dba-de101e5f379b tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:59.031736 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-c92ac254-4161-4802-9dba-de101e5f379b tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1751 microversion: 2.20 time: 0.309479 Jul 05 13:03:59.032330 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 212/414] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:03:58 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1751 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 13:03:59.046706 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-7192814f-e4bb-4616-9a61-8023f3b9984d tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:59.053316 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-7192814f-e4bb-4616-9a61-8023f3b9984d tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] [instance: 058a9566-8f0f-4920-b435-22ea5bee15e7] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:59.063550 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-7192814f-e4bb-4616-9a61-8023f3b9984d tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:59.064245 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-7192814f-e4bb-4616-9a61-8023f3b9984d tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:59.065210 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-7192814f-e4bb-4616-9a61-8023f3b9984d tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:59.067286 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-7192814f-e4bb-4616-9a61-8023f3b9984d tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:59.116539 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-8cae57b6-2a14-4b5d-9f63-67f4d9f410bd tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf000835f1f48cca0a46b233e52c8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec699c3dd1ab470c8cc0685e6e9f766a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:59.133407 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-8cae57b6-2a14-4b5d-9f63-67f4d9f410bd tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] 10.222.0.36 "GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6" status: 200 len: 1259 microversion: 2.1 time: 0.255377 Jul 05 13:03:59.134312 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 203/415] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:58 2022] GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6 => generated 1259 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:59.260758 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-7192814f-e4bb-4616-9a61-8023f3b9984d tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4a4bd26db664e44850f5ebccd838315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380379df1d7e4ebe90c75bcefecbc787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:03:59.268737 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-7192814f-e4bb-4616-9a61-8023f3b9984d tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] 10.222.0.36 "GET /compute/v2.1/servers/058a9566-8f0f-4920-b435-22ea5bee15e7" status: 200 len: 1314 microversion: 2.1 time: 0.228545 Jul 05 13:03:59.269397 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 213/416] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:59 2022] GET /compute/v2.1/servers/058a9566-8f0f-4920-b435-22ea5bee15e7 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:03:59.301706 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-2836e231-e047-4688-93f8-bb9a989a7a0f req-b031e69e-84e1-444e-94bd-6778ffe51098 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58708391-4350-4b7e-8616-f3f3534bd2e6", "tag": "dea25a3b-1daa-482f-9f40-46b326121051"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:03:59.310042 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-2836e231-e047-4688-93f8-bb9a989a7a0f req-b031e69e-84e1-444e-94bd-6778ffe51098 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:59.310484 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-2836e231-e047-4688-93f8-bb9a989a7a0f req-b031e69e-84e1-444e-94bd-6778ffe51098 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:59.322625 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-2836e231-e047-4688-93f8-bb9a989a7a0f req-b031e69e-84e1-444e-94bd-6778ffe51098 service nova] Creating event network-changed:dea25a3b-1daa-482f-9f40-46b326121051 for instance 58708391-4350-4b7e-8616-f3f3534bd2e6 on hv-cinder-79760 Jul 05 13:03:59.327793 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-2836e231-e047-4688-93f8-bb9a989a7a0f req-b031e69e-84e1-444e-94bd-6778ffe51098 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029777 Jul 05 13:03:59.328491 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 204/417] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:03:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:03:59.892703 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-947792ac-c586-44e5-a1f3-e651c033b6c5 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:03:59.893505 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-947792ac-c586-44e5-a1f3-e651c033b6c5 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 7b7f15b2-a00e-4172-983d-f2a80401953b] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:03:59.907681 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-947792ac-c586-44e5-a1f3-e651c033b6c5 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:59.910276 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-947792ac-c586-44e5-a1f3-e651c033b6c5 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:03:59.911131 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-947792ac-c586-44e5-a1f3-e651c033b6c5 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:03:59.915972 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-947792ac-c586-44e5-a1f3-e651c033b6c5 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:00.052282 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-b9c0c41f-8699-422e-8764-c3c296a7efe9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:00.053020 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-b9c0c41f-8699-422e-8764-c3c296a7efe9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:00.065206 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b9c0c41f-8699-422e-8764-c3c296a7efe9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:00.065669 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b9c0c41f-8699-422e-8764-c3c296a7efe9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:00.068412 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b9c0c41f-8699-422e-8764-c3c296a7efe9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:00.068940 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b9c0c41f-8699-422e-8764-c3c296a7efe9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:00.194555 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-947792ac-c586-44e5-a1f3-e651c033b6c5 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:00.206044 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-947792ac-c586-44e5-a1f3-e651c033b6c5 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b" status: 200 len: 1371 microversion: 2.1 time: 0.318216 Jul 05 13:04:00.206624 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 214/418] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:03:59 2022] GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b => generated 1371 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:04:00.211687 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-05f4c260-2f3b-4606-8caf-a55904cb60b5 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:00.212292 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-05f4c260-2f3b-4606-8caf-a55904cb60b5 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] [instance: 58708391-4350-4b7e-8616-f3f3534bd2e6] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:00.235400 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-05f4c260-2f3b-4606-8caf-a55904cb60b5 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:00.236071 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-05f4c260-2f3b-4606-8caf-a55904cb60b5 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:00.237044 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-05f4c260-2f3b-4606-8caf-a55904cb60b5 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:00.237662 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-05f4c260-2f3b-4606-8caf-a55904cb60b5 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:00.349597 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-b9c0c41f-8699-422e-8764-c3c296a7efe9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:00.352292 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:04:00.361404 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-b9c0c41f-8699-422e-8764-c3c296a7efe9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:00.367523 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-b9c0c41f-8699-422e-8764-c3c296a7efe9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:00.367523 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-b9c0c41f-8699-422e-8764-c3c296a7efe9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1751 microversion: 2.20 time: 0.317162 Jul 05 13:04:00.373781 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 205/419] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:04:00 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1751 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:04:00.385299 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-8cd23ecd-594f-44e5-b874-584a00eef135 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:00.387366 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-8cd23ecd-594f-44e5-b874-584a00eef135 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] [instance: 058a9566-8f0f-4920-b435-22ea5bee15e7] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:00.398335 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8cd23ecd-594f-44e5-b874-584a00eef135 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:00.398792 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8cd23ecd-594f-44e5-b874-584a00eef135 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:00.399571 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8cd23ecd-594f-44e5-b874-584a00eef135 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:00.400004 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8cd23ecd-594f-44e5-b874-584a00eef135 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:00.529692 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-05f4c260-2f3b-4606-8caf-a55904cb60b5 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf000835f1f48cca0a46b233e52c8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec699c3dd1ab470c8cc0685e6e9f766a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:00.549139 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-05f4c260-2f3b-4606-8caf-a55904cb60b5 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] 10.222.0.36 "GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6" status: 200 len: 1259 microversion: 2.1 time: 0.332749 Jul 05 13:04:00.549139 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 215/420] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:04:00 2022] GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6 => generated 1259 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:04:00.636144 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-8cd23ecd-594f-44e5-b874-584a00eef135 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4a4bd26db664e44850f5ebccd838315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380379df1d7e4ebe90c75bcefecbc787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:00.648850 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-8cd23ecd-594f-44e5-b874-584a00eef135 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] 10.222.0.36 "GET /compute/v2.1/servers/058a9566-8f0f-4920-b435-22ea5bee15e7" status: 200 len: 1314 microversion: 2.1 time: 0.271388 Jul 05 13:04:00.649481 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 206/421] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:04:00 2022] GET /compute/v2.1/servers/058a9566-8f0f-4920-b435-22ea5bee15e7 => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:04:01.220417 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_cell0:SELECT=4 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:04:01.225797 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-f4511c3a-ef9b-4006-a972-96a92caac64d tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:01.226479 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-f4511c3a-ef9b-4006-a972-96a92caac64d tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 7b7f15b2-a00e-4172-983d-f2a80401953b] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:01.241901 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f4511c3a-ef9b-4006-a972-96a92caac64d tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:01.242351 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f4511c3a-ef9b-4006-a972-96a92caac64d tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:01.243130 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f4511c3a-ef9b-4006-a972-96a92caac64d tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:01.243738 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f4511c3a-ef9b-4006-a972-96a92caac64d tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:01.392877 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-ec784be7-40f6-4638-92c0-7c178e7121a2 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:01.393704 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-ec784be7-40f6-4638-92c0-7c178e7121a2 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:01.401971 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ec784be7-40f6-4638-92c0-7c178e7121a2 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:01.403090 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ec784be7-40f6-4638-92c0-7c178e7121a2 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:01.404012 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ec784be7-40f6-4638-92c0-7c178e7121a2 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:01.404526 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ec784be7-40f6-4638-92c0-7c178e7121a2 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:01.779817 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-f4511c3a-ef9b-4006-a972-96a92caac64d tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:01.788942 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-f4511c3a-ef9b-4006-a972-96a92caac64d tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b" status: 200 len: 1371 microversion: 2.1 time: 0.569150 Jul 05 13:04:01.789446 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 216/422] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:04:01 2022] GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b => generated 1371 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:04:01.794473 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-e9ac83fa-e7e2-44cb-88fa-869d28fe635b tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:01.796854 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-e9ac83fa-e7e2-44cb-88fa-869d28fe635b tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] [instance: 58708391-4350-4b7e-8616-f3f3534bd2e6] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:01.807718 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e9ac83fa-e7e2-44cb-88fa-869d28fe635b tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:01.808230 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e9ac83fa-e7e2-44cb-88fa-869d28fe635b tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:01.809039 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e9ac83fa-e7e2-44cb-88fa-869d28fe635b tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:01.809478 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e9ac83fa-e7e2-44cb-88fa-869d28fe635b tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:01.811013 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-ec784be7-40f6-4638-92c0-7c178e7121a2 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:01.826858 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-ec784be7-40f6-4638-92c0-7c178e7121a2 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:01.828369 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-ec784be7-40f6-4638-92c0-7c178e7121a2 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:01.843776 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-ec784be7-40f6-4638-92c0-7c178e7121a2 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1753 microversion: 2.20 time: 0.441741 Jul 05 13:04:01.843776 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 207/423] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:04:01 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1753 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:04:01.843776 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-d7b91419-5315-47a1-9dda-fbb3064f6cb5 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:01.843776 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-d7b91419-5315-47a1-9dda-fbb3064f6cb5 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] [instance: 058a9566-8f0f-4920-b435-22ea5bee15e7] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:01.850730 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d7b91419-5315-47a1-9dda-fbb3064f6cb5 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:01.851186 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d7b91419-5315-47a1-9dda-fbb3064f6cb5 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:01.852402 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d7b91419-5315-47a1-9dda-fbb3064f6cb5 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:01.852882 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d7b91419-5315-47a1-9dda-fbb3064f6cb5 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:01.990601 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-e9ac83fa-e7e2-44cb-88fa-869d28fe635b tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf000835f1f48cca0a46b233e52c8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec699c3dd1ab470c8cc0685e6e9f766a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:01.998255 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-e9ac83fa-e7e2-44cb-88fa-869d28fe635b tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] 10.222.0.36 "GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6" status: 200 len: 1259 microversion: 2.1 time: 0.207641 Jul 05 13:04:02.007809 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 217/424] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:04:01 2022] GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6 => generated 1259 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:04:02.023580 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-d7b91419-5315-47a1-9dda-fbb3064f6cb5 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4a4bd26db664e44850f5ebccd838315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380379df1d7e4ebe90c75bcefecbc787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:02.030934 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-d7b91419-5315-47a1-9dda-fbb3064f6cb5 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] 10.222.0.36 "GET /compute/v2.1/servers/058a9566-8f0f-4920-b435-22ea5bee15e7" status: 200 len: 1314 microversion: 2.1 time: 0.199880 Jul 05 13:04:02.031500 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 208/425] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:04:01 2022] GET /compute/v2.1/servers/058a9566-8f0f-4920-b435-22ea5bee15e7 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:04:02.805816 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-ed1d7095-72cf-4ece-b48b-310162d0d17f tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:02.807003 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-ed1d7095-72cf-4ece-b48b-310162d0d17f tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 7b7f15b2-a00e-4172-983d-f2a80401953b] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:02.813643 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ed1d7095-72cf-4ece-b48b-310162d0d17f tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:02.814115 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ed1d7095-72cf-4ece-b48b-310162d0d17f tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:02.815460 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ed1d7095-72cf-4ece-b48b-310162d0d17f tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:02.815460 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ed1d7095-72cf-4ece-b48b-310162d0d17f tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:02.834454 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:04:02.854028 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-3483418c-059a-4d92-b9ac-a17a7e314efc tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:02.854639 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-3483418c-059a-4d92-b9ac-a17a7e314efc tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:02.864886 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3483418c-059a-4d92-b9ac-a17a7e314efc tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:02.865344 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3483418c-059a-4d92-b9ac-a17a7e314efc tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:02.866106 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3483418c-059a-4d92-b9ac-a17a7e314efc tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:02.866590 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3483418c-059a-4d92-b9ac-a17a7e314efc tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:02.892220 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_cell0:SELECT=22 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:04:03.019675 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-ed1d7095-72cf-4ece-b48b-310162d0d17f tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:03.029418 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-ed1d7095-72cf-4ece-b48b-310162d0d17f tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b" status: 200 len: 1371 microversion: 2.1 time: 0.227350 Jul 05 13:04:03.030669 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 218/426] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:04:02 2022] GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b => generated 1371 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:04:03.036009 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-b67eeebf-e961-4cdd-b630-180a42fa7b9d tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:03.036818 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-b67eeebf-e961-4cdd-b630-180a42fa7b9d tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] [instance: 58708391-4350-4b7e-8616-f3f3534bd2e6] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:03.044061 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b67eeebf-e961-4cdd-b630-180a42fa7b9d tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:03.044876 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b67eeebf-e961-4cdd-b630-180a42fa7b9d tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:03.045808 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b67eeebf-e961-4cdd-b630-180a42fa7b9d tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:03.046851 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b67eeebf-e961-4cdd-b630-180a42fa7b9d tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:03.055162 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-3483418c-059a-4d92-b9ac-a17a7e314efc tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:03.064260 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-3483418c-059a-4d92-b9ac-a17a7e314efc tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:03.065859 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-3483418c-059a-4d92-b9ac-a17a7e314efc tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:03.067908 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-3483418c-059a-4d92-b9ac-a17a7e314efc tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1753 microversion: 2.20 time: 0.218298 Jul 05 13:04:03.079828 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 209/427] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:04:02 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1753 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:04:03.084879 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-2ab31387-f18a-435f-8564-2308f5a1e9ca tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:03.085889 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-2ab31387-f18a-435f-8564-2308f5a1e9ca tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] [instance: 058a9566-8f0f-4920-b435-22ea5bee15e7] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:03.092359 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2ab31387-f18a-435f-8564-2308f5a1e9ca tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:03.093145 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2ab31387-f18a-435f-8564-2308f5a1e9ca tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:03.094149 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2ab31387-f18a-435f-8564-2308f5a1e9ca tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:03.094851 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2ab31387-f18a-435f-8564-2308f5a1e9ca tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:03.280154 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-b67eeebf-e961-4cdd-b630-180a42fa7b9d tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf000835f1f48cca0a46b233e52c8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec699c3dd1ab470c8cc0685e6e9f766a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:03.290902 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-b67eeebf-e961-4cdd-b630-180a42fa7b9d tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] 10.222.0.36 "GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6" status: 200 len: 1259 microversion: 2.1 time: 0.258797 Jul 05 13:04:03.301433 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 219/428] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:04:03 2022] GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6 => generated 1259 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:04:03.301761 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-2ab31387-f18a-435f-8564-2308f5a1e9ca tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4a4bd26db664e44850f5ebccd838315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380379df1d7e4ebe90c75bcefecbc787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:03.308716 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-2ab31387-f18a-435f-8564-2308f5a1e9ca tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] 10.222.0.36 "GET /compute/v2.1/servers/058a9566-8f0f-4920-b435-22ea5bee15e7" status: 200 len: 1314 microversion: 2.1 time: 0.227431 Jul 05 13:04:03.309255 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 210/429] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:04:03 2022] GET /compute/v2.1/servers/058a9566-8f0f-4920-b435-22ea5bee15e7 => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:04:04.053820 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-906f3204-873c-400b-a4b2-aaced91a7ac7 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:04.055313 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-906f3204-873c-400b-a4b2-aaced91a7ac7 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 7b7f15b2-a00e-4172-983d-f2a80401953b] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:04.072168 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-906f3204-873c-400b-a4b2-aaced91a7ac7 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:04.075642 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-906f3204-873c-400b-a4b2-aaced91a7ac7 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:04.075642 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-906f3204-873c-400b-a4b2-aaced91a7ac7 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:04.075642 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-906f3204-873c-400b-a4b2-aaced91a7ac7 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:04.087748 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-a77bd7ce-8e9a-461e-9e41-cd4c6eba4508 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:04.089336 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-a77bd7ce-8e9a-461e-9e41-cd4c6eba4508 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:04.099674 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a77bd7ce-8e9a-461e-9e41-cd4c6eba4508 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:04.100520 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a77bd7ce-8e9a-461e-9e41-cd4c6eba4508 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:04.102883 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a77bd7ce-8e9a-461e-9e41-cd4c6eba4508 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:04.103572 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a77bd7ce-8e9a-461e-9e41-cd4c6eba4508 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:04.335708 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-a77bd7ce-8e9a-461e-9e41-cd4c6eba4508 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:04.348262 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-a77bd7ce-8e9a-461e-9e41-cd4c6eba4508 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:04.348715 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-906f3204-873c-400b-a4b2-aaced91a7ac7 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:04.351363 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-a77bd7ce-8e9a-461e-9e41-cd4c6eba4508 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:04.353768 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-a77bd7ce-8e9a-461e-9e41-cd4c6eba4508 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1753 microversion: 2.20 time: 0.269316 Jul 05 13:04:04.356116 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 211/430] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:04:04 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1753 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:04:04.357551 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-906f3204-873c-400b-a4b2-aaced91a7ac7 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b" status: 200 len: 1371 microversion: 2.1 time: 0.313977 Jul 05 13:04:04.358529 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 220/431] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:04:04 2022] GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b => generated 1371 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:04:04.371971 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-d2b4eb19-23ba-4360-aea3-47f952896b21 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:04.373585 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-25926071-5281-4aa2-9ee9-6b601c441c60 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:04.373927 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-d2b4eb19-23ba-4360-aea3-47f952896b21 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] [instance: 58708391-4350-4b7e-8616-f3f3534bd2e6] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:04.374204 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-25926071-5281-4aa2-9ee9-6b601c441c60 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] [instance: 058a9566-8f0f-4920-b435-22ea5bee15e7] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:04.382665 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d2b4eb19-23ba-4360-aea3-47f952896b21 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:04.383579 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d2b4eb19-23ba-4360-aea3-47f952896b21 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:04.384650 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d2b4eb19-23ba-4360-aea3-47f952896b21 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:04.385495 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d2b4eb19-23ba-4360-aea3-47f952896b21 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:04.392070 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-25926071-5281-4aa2-9ee9-6b601c441c60 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:04.393879 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-25926071-5281-4aa2-9ee9-6b601c441c60 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:04.396871 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-25926071-5281-4aa2-9ee9-6b601c441c60 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:04.397499 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-25926071-5281-4aa2-9ee9-6b601c441c60 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:04.681624 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-25926071-5281-4aa2-9ee9-6b601c441c60 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4a4bd26db664e44850f5ebccd838315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380379df1d7e4ebe90c75bcefecbc787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:04.693265 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-25926071-5281-4aa2-9ee9-6b601c441c60 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] 10.222.0.36 "GET /compute/v2.1/servers/058a9566-8f0f-4920-b435-22ea5bee15e7" status: 200 len: 1314 microversion: 2.1 time: 0.333526 Jul 05 13:04:04.705164 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 221/432] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:04:04 2022] GET /compute/v2.1/servers/058a9566-8f0f-4920-b435-22ea5bee15e7 => generated 1314 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:04:04.710019 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-d2b4eb19-23ba-4360-aea3-47f952896b21 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf000835f1f48cca0a46b233e52c8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec699c3dd1ab470c8cc0685e6e9f766a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:04.719647 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-d2b4eb19-23ba-4360-aea3-47f952896b21 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] 10.222.0.36 "GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6" status: 200 len: 1259 microversion: 2.1 time: 0.361627 Jul 05 13:04:04.721020 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 212/433] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:04:04 2022] GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6 => generated 1259 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:04:05.373115 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-c9a4aee6-c106-4af5-85f9-4bd5463c364a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:05.382047 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-ca1afb08-112c-495e-83a6-7bd8a78e2dd0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:05.384841 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-c9a4aee6-c106-4af5-85f9-4bd5463c364a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:05.387986 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-ca1afb08-112c-495e-83a6-7bd8a78e2dd0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 7b7f15b2-a00e-4172-983d-f2a80401953b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:05.399762 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-c9a4aee6-c106-4af5-85f9-4bd5463c364a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:05.399762 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-c9a4aee6-c106-4af5-85f9-4bd5463c364a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:05.405961 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-c9a4aee6-c106-4af5-85f9-4bd5463c364a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:05.406751 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ca1afb08-112c-495e-83a6-7bd8a78e2dd0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:05.407119 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-c9a4aee6-c106-4af5-85f9-4bd5463c364a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:05.407581 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ca1afb08-112c-495e-83a6-7bd8a78e2dd0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:05.408797 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ca1afb08-112c-495e-83a6-7bd8a78e2dd0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:05.409407 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ca1afb08-112c-495e-83a6-7bd8a78e2dd0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:05.744571 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-ca1afb08-112c-495e-83a6-7bd8a78e2dd0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:05.752252 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-ca1afb08-112c-495e-83a6-7bd8a78e2dd0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b" status: 200 len: 1371 microversion: 2.1 time: 0.374777 Jul 05 13:04:05.763184 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 213/434] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:04:05 2022] GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b => generated 1371 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:04:05.771530 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-69540e36-182b-4b90-ab32-2206e533a9c2 req-7ae95b42-7e7e-4f77-ab14-33b1c8c48c46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b7f15b2-a00e-4172-983d-f2a80401953b", "name": "network-vif-plugged", "status": "completed", "tag": "31d1ed43-9fb9-4a56-aa9d-2fb0657cefdc"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:04:05.781708 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-69540e36-182b-4b90-ab32-2206e533a9c2 req-7ae95b42-7e7e-4f77-ab14-33b1c8c48c46 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:05.782247 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-69540e36-182b-4b90-ab32-2206e533a9c2 req-7ae95b42-7e7e-4f77-ab14-33b1c8c48c46 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:05.787606 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-c9a4aee6-c106-4af5-85f9-4bd5463c364a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:05.795746 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-69540e36-182b-4b90-ab32-2206e533a9c2 req-7ae95b42-7e7e-4f77-ab14-33b1c8c48c46 service nova] Creating event network-vif-plugged:31d1ed43-9fb9-4a56-aa9d-2fb0657cefdc for instance 7b7f15b2-a00e-4172-983d-f2a80401953b on hv-cinder-79760 Jul 05 13:04:05.801690 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-c9a4aee6-c106-4af5-85f9-4bd5463c364a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:05.804718 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-69540e36-182b-4b90-ab32-2206e533a9c2 req-7ae95b42-7e7e-4f77-ab14-33b1c8c48c46 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038427 Jul 05 13:04:05.804718 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 214/435] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:04:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:04:05.805649 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-c9a4aee6-c106-4af5-85f9-4bd5463c364a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:05.806845 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-c9a4aee6-c106-4af5-85f9-4bd5463c364a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1753 microversion: 2.20 time: 0.438001 Jul 05 13:04:05.809037 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-80bfc634-4c99-4c79-9849-a1fa23ef32c9 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:05.815649 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 222/436] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:04:05 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1753 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:04:05.828613 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-f7be9b79-39fe-46c2-b732-f035251c6c4c tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:05.829372 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-f7be9b79-39fe-46c2-b732-f035251c6c4c tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] [instance: 58708391-4350-4b7e-8616-f3f3534bd2e6] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:05.833667 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-80bfc634-4c99-4c79-9849-a1fa23ef32c9 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] [instance: 058a9566-8f0f-4920-b435-22ea5bee15e7] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:05.836230 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f7be9b79-39fe-46c2-b732-f035251c6c4c tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:05.836785 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f7be9b79-39fe-46c2-b732-f035251c6c4c tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:05.837562 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f7be9b79-39fe-46c2-b732-f035251c6c4c tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:05.838000 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f7be9b79-39fe-46c2-b732-f035251c6c4c tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:05.841704 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-80bfc634-4c99-4c79-9849-a1fa23ef32c9 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:05.842148 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-80bfc634-4c99-4c79-9849-a1fa23ef32c9 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:05.844122 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-80bfc634-4c99-4c79-9849-a1fa23ef32c9 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:05.844849 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-80bfc634-4c99-4c79-9849-a1fa23ef32c9 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:06.084550 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-80bfc634-4c99-4c79-9849-a1fa23ef32c9 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4a4bd26db664e44850f5ebccd838315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380379df1d7e4ebe90c75bcefecbc787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:06.096353 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-80bfc634-4c99-4c79-9849-a1fa23ef32c9 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] 10.222.0.36 "GET /compute/v2.1/servers/058a9566-8f0f-4920-b435-22ea5bee15e7" status: 200 len: 1314 microversion: 2.1 time: 0.291534 Jul 05 13:04:06.103900 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 215/437] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:04:05 2022] GET /compute/v2.1/servers/058a9566-8f0f-4920-b435-22ea5bee15e7 => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:04:06.138802 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-f7be9b79-39fe-46c2-b732-f035251c6c4c tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf000835f1f48cca0a46b233e52c8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec699c3dd1ab470c8cc0685e6e9f766a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:06.139276 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-f7be9b79-39fe-46c2-b732-f035251c6c4c tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] 10.222.0.36 "GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6" status: 200 len: 1259 microversion: 2.1 time: 0.321558 Jul 05 13:04:06.139585 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 223/438] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:04:05 2022] GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6 => generated 1259 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:04:06.771124 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-9e6524d4-16b7-42aa-a043-baf9c0eff687 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:06.772640 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-9e6524d4-16b7-42aa-a043-baf9c0eff687 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 7b7f15b2-a00e-4172-983d-f2a80401953b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:06.781656 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9e6524d4-16b7-42aa-a043-baf9c0eff687 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:06.782139 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9e6524d4-16b7-42aa-a043-baf9c0eff687 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:06.783566 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9e6524d4-16b7-42aa-a043-baf9c0eff687 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:06.784304 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9e6524d4-16b7-42aa-a043-baf9c0eff687 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:06.833610 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-678c324b-1a27-49c0-906a-be87157e21ae tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:06.834373 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-678c324b-1a27-49c0-906a-be87157e21ae tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:06.842147 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-678c324b-1a27-49c0-906a-be87157e21ae tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:06.845925 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-678c324b-1a27-49c0-906a-be87157e21ae tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:06.846974 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-678c324b-1a27-49c0-906a-be87157e21ae tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:06.850808 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-678c324b-1a27-49c0-906a-be87157e21ae tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:07.024845 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-9e6524d4-16b7-42aa-a043-baf9c0eff687 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:07.038042 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-678c324b-1a27-49c0-906a-be87157e21ae tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:07.047213 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-678c324b-1a27-49c0-906a-be87157e21ae tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:07.048528 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-9e6524d4-16b7-42aa-a043-baf9c0eff687 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b" status: 200 len: 1371 microversion: 2.1 time: 0.282207 Jul 05 13:04:07.058257 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 216/439] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:04:06 2022] GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b => generated 1371 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:04:07.058874 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-678c324b-1a27-49c0-906a-be87157e21ae tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:07.059874 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-678c324b-1a27-49c0-906a-be87157e21ae tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1809 microversion: 2.20 time: 0.230885 Jul 05 13:04:07.061605 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 224/440] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:04:06 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1809 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:04:07.120656 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-98c03d20-a8e5-47ba-94aa-4f599cc60c70 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:07.121277 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-98c03d20-a8e5-47ba-94aa-4f599cc60c70 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] [instance: 058a9566-8f0f-4920-b435-22ea5bee15e7] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:07.128110 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-98c03d20-a8e5-47ba-94aa-4f599cc60c70 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:07.128555 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-98c03d20-a8e5-47ba-94aa-4f599cc60c70 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:07.130039 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-98c03d20-a8e5-47ba-94aa-4f599cc60c70 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:07.135978 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-98c03d20-a8e5-47ba-94aa-4f599cc60c70 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:07.156355 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-28d3075d-d176-49a3-ad45-139a2467b1c9 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:07.157516 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-28d3075d-d176-49a3-ad45-139a2467b1c9 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] [instance: 58708391-4350-4b7e-8616-f3f3534bd2e6] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:07.168159 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-28d3075d-d176-49a3-ad45-139a2467b1c9 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:07.168882 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-28d3075d-d176-49a3-ad45-139a2467b1c9 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:07.169825 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-28d3075d-d176-49a3-ad45-139a2467b1c9 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:07.170399 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-28d3075d-d176-49a3-ad45-139a2467b1c9 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:07.397538 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-98c03d20-a8e5-47ba-94aa-4f599cc60c70 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4a4bd26db664e44850f5ebccd838315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380379df1d7e4ebe90c75bcefecbc787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:07.409715 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-98c03d20-a8e5-47ba-94aa-4f599cc60c70 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] 10.222.0.36 "GET /compute/v2.1/servers/058a9566-8f0f-4920-b435-22ea5bee15e7" status: 200 len: 1314 microversion: 2.1 time: 0.293466 Jul 05 13:04:07.410687 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 217/441] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:04:07 2022] GET /compute/v2.1/servers/058a9566-8f0f-4920-b435-22ea5bee15e7 => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:04:07.414816 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-28d3075d-d176-49a3-ad45-139a2467b1c9 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf000835f1f48cca0a46b233e52c8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec699c3dd1ab470c8cc0685e6e9f766a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:07.423343 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-28d3075d-d176-49a3-ad45-139a2467b1c9 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] 10.222.0.36 "GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6" status: 200 len: 1259 microversion: 2.1 time: 0.270540 Jul 05 13:04:07.424229 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 225/442] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:04:07 2022] GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6 => generated 1259 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:04:07.830941 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-8b9b793a-de38-48d9-a3eb-2b900f957d25 req-80c7c408-e0d4-4f6f-b879-3cda55dd1d79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "058a9566-8f0f-4920-b435-22ea5bee15e7", "name": "network-vif-plugged", "status": "completed", "tag": "e7af3335-2286-40b5-bde4-70b80fbc82bd"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:04:07.840724 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-8b9b793a-de38-48d9-a3eb-2b900f957d25 req-80c7c408-e0d4-4f6f-b879-3cda55dd1d79 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:07.841167 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-8b9b793a-de38-48d9-a3eb-2b900f957d25 req-80c7c408-e0d4-4f6f-b879-3cda55dd1d79 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:07.862311 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-8b9b793a-de38-48d9-a3eb-2b900f957d25 req-80c7c408-e0d4-4f6f-b879-3cda55dd1d79 service nova] Creating event network-vif-plugged:e7af3335-2286-40b5-bde4-70b80fbc82bd for instance 058a9566-8f0f-4920-b435-22ea5bee15e7 on hv-cinder-79760 Jul 05 13:04:07.875328 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-8b9b793a-de38-48d9-a3eb-2b900f957d25 req-80c7c408-e0d4-4f6f-b879-3cda55dd1d79 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053562 Jul 05 13:04:07.876265 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 218/443] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:04:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:04:08.066332 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-80f35f58-8785-4309-b8af-43d7349b0d92 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:08.067062 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-80f35f58-8785-4309-b8af-43d7349b0d92 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 7b7f15b2-a00e-4172-983d-f2a80401953b] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:08.080733 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-0f182ec6-043d-4983-90fe-ff2c1c99364c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:08.080949 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-80f35f58-8785-4309-b8af-43d7349b0d92 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:08.081792 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-0f182ec6-043d-4983-90fe-ff2c1c99364c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:08.082398 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-80f35f58-8785-4309-b8af-43d7349b0d92 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:08.083831 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-80f35f58-8785-4309-b8af-43d7349b0d92 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:08.084448 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-80f35f58-8785-4309-b8af-43d7349b0d92 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:08.093108 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0f182ec6-043d-4983-90fe-ff2c1c99364c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:08.093803 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0f182ec6-043d-4983-90fe-ff2c1c99364c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:08.094820 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0f182ec6-043d-4983-90fe-ff2c1c99364c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:08.095488 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0f182ec6-043d-4983-90fe-ff2c1c99364c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:08.336186 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-80f35f58-8785-4309-b8af-43d7349b0d92 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:08.349082 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-80f35f58-8785-4309-b8af-43d7349b0d92 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b" status: 200 len: 1371 microversion: 2.1 time: 0.285949 Jul 05 13:04:08.349705 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 226/444] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:04:08 2022] GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b => generated 1371 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:04:08.372612 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-0f182ec6-043d-4983-90fe-ff2c1c99364c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:08.383426 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-0f182ec6-043d-4983-90fe-ff2c1c99364c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:08.385793 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-0f182ec6-043d-4983-90fe-ff2c1c99364c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:08.387369 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-0f182ec6-043d-4983-90fe-ff2c1c99364c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1809 microversion: 2.20 time: 0.311586 Jul 05 13:04:08.388099 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 219/445] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:04:08 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1809 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:04:08.427891 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-50ce3a7c-2630-4d94-913e-4c4b8e519403 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:08.429030 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-50ce3a7c-2630-4d94-913e-4c4b8e519403 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] [instance: 058a9566-8f0f-4920-b435-22ea5bee15e7] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:08.436563 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-50ce3a7c-2630-4d94-913e-4c4b8e519403 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:08.437043 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-50ce3a7c-2630-4d94-913e-4c4b8e519403 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:08.437977 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-50ce3a7c-2630-4d94-913e-4c4b8e519403 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:08.438952 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-50ce3a7c-2630-4d94-913e-4c4b8e519403 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:08.442324 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-cf3945af-fa73-41dd-a9c8-12ea6c49d82e tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:08.442962 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-cf3945af-fa73-41dd-a9c8-12ea6c49d82e tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] [instance: 58708391-4350-4b7e-8616-f3f3534bd2e6] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:08.449236 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cf3945af-fa73-41dd-a9c8-12ea6c49d82e tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:08.449687 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cf3945af-fa73-41dd-a9c8-12ea6c49d82e tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:08.450479 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cf3945af-fa73-41dd-a9c8-12ea6c49d82e tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:08.451091 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cf3945af-fa73-41dd-a9c8-12ea6c49d82e tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:08.670087 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-50ce3a7c-2630-4d94-913e-4c4b8e519403 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4a4bd26db664e44850f5ebccd838315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380379df1d7e4ebe90c75bcefecbc787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:08.677404 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-cf3945af-fa73-41dd-a9c8-12ea6c49d82e tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf000835f1f48cca0a46b233e52c8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec699c3dd1ab470c8cc0685e6e9f766a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:08.678243 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-50ce3a7c-2630-4d94-913e-4c4b8e519403 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] 10.222.0.36 "GET /compute/v2.1/servers/058a9566-8f0f-4920-b435-22ea5bee15e7" status: 200 len: 1314 microversion: 2.1 time: 0.255474 Jul 05 13:04:08.687734 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-cf3945af-fa73-41dd-a9c8-12ea6c49d82e tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] 10.222.0.36 "GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6" status: 200 len: 1259 microversion: 2.1 time: 0.249324 Jul 05 13:04:08.688389 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 227/446] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:04:08 2022] GET /compute/v2.1/servers/058a9566-8f0f-4920-b435-22ea5bee15e7 => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:04:08.688849 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 220/447] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:04:08 2022] GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6 => generated 1259 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:04:09.366751 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-c06c5c25-3052-47e6-af4b-0cdad73942e6 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:09.367180 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-c06c5c25-3052-47e6-af4b-0cdad73942e6 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 7b7f15b2-a00e-4172-983d-f2a80401953b] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:09.377873 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-c06c5c25-3052-47e6-af4b-0cdad73942e6 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:09.378901 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-c06c5c25-3052-47e6-af4b-0cdad73942e6 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:09.379113 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-c06c5c25-3052-47e6-af4b-0cdad73942e6 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:09.379555 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-c06c5c25-3052-47e6-af4b-0cdad73942e6 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:09.407112 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-d9b3a9d3-4c32-4b94-a80e-d0f2e54c20e2 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:09.407824 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-d9b3a9d3-4c32-4b94-a80e-d0f2e54c20e2 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:09.417235 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d9b3a9d3-4c32-4b94-a80e-d0f2e54c20e2 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:09.417922 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d9b3a9d3-4c32-4b94-a80e-d0f2e54c20e2 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:09.419492 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d9b3a9d3-4c32-4b94-a80e-d0f2e54c20e2 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:09.420472 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d9b3a9d3-4c32-4b94-a80e-d0f2e54c20e2 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:09.624396 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-c06c5c25-3052-47e6-af4b-0cdad73942e6 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:09.634589 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-c06c5c25-3052-47e6-af4b-0cdad73942e6 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b" status: 200 len: 1565 microversion: 2.1 time: 0.272964 Jul 05 13:04:09.635771 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 228/448] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:04:09 2022] GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b => generated 1565 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:04:09.656144 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-22305a90-1a10-40de-878a-4e3c73c93b7f tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:09.657530 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-22305a90-1a10-40de-878a-4e3c73c93b7f tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 7b7f15b2-a00e-4172-983d-f2a80401953b] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:09.672236 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-22305a90-1a10-40de-878a-4e3c73c93b7f tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:09.674794 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-22305a90-1a10-40de-878a-4e3c73c93b7f tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:09.675748 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-22305a90-1a10-40de-878a-4e3c73c93b7f tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:09.677110 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-22305a90-1a10-40de-878a-4e3c73c93b7f tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:09.690158 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-d9b3a9d3-4c32-4b94-a80e-d0f2e54c20e2 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:09.699449 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-d9b3a9d3-4c32-4b94-a80e-d0f2e54c20e2 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:09.701098 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-d9b3a9d3-4c32-4b94-a80e-d0f2e54c20e2 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:09.702504 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-d9b3a9d3-4c32-4b94-a80e-d0f2e54c20e2 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1809 microversion: 2.20 time: 0.300859 Jul 05 13:04:09.703873 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 221/449] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:04:09 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1809 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 13:04:09.710972 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-28ff676e-9a1f-4456-98cb-cc4e20e90f53 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:09.711844 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-28ff676e-9a1f-4456-98cb-cc4e20e90f53 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] [instance: 058a9566-8f0f-4920-b435-22ea5bee15e7] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:09.725464 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-28ff676e-9a1f-4456-98cb-cc4e20e90f53 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:09.726317 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-28ff676e-9a1f-4456-98cb-cc4e20e90f53 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:09.727551 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-28ff676e-9a1f-4456-98cb-cc4e20e90f53 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:09.728444 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-28ff676e-9a1f-4456-98cb-cc4e20e90f53 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:09.882236 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-22305a90-1a10-40de-878a-4e3c73c93b7f tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.232384 Jul 05 13:04:09.883892 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 229/450] 10.222.0.36 () {58 vars in 1274 bytes} [Tue Jul 5 13:04:09 2022] GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b/os-interface => generated 284 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 13:04:09.893641 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-63209099-7abe-424e-b77e-3d5406c33f8d tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:09.895275 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-63209099-7abe-424e-b77e-3d5406c33f8d tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] [instance: 58708391-4350-4b7e-8616-f3f3534bd2e6] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:09.912706 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-63209099-7abe-424e-b77e-3d5406c33f8d tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:09.913953 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-63209099-7abe-424e-b77e-3d5406c33f8d tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:09.916238 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-63209099-7abe-424e-b77e-3d5406c33f8d tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:09.918453 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-63209099-7abe-424e-b77e-3d5406c33f8d tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:10.102034 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-28ff676e-9a1f-4456-98cb-cc4e20e90f53 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4a4bd26db664e44850f5ebccd838315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380379df1d7e4ebe90c75bcefecbc787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:10.115822 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-28ff676e-9a1f-4456-98cb-cc4e20e90f53 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] 10.222.0.36 "GET /compute/v2.1/servers/058a9566-8f0f-4920-b435-22ea5bee15e7" status: 200 len: 1314 microversion: 2.1 time: 0.410542 Jul 05 13:04:10.116647 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 222/451] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:04:09 2022] GET /compute/v2.1/servers/058a9566-8f0f-4920-b435-22ea5bee15e7 => generated 1314 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:04:10.603687 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-63209099-7abe-424e-b77e-3d5406c33f8d tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf000835f1f48cca0a46b233e52c8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec699c3dd1ab470c8cc0685e6e9f766a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:10.612529 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-63209099-7abe-424e-b77e-3d5406c33f8d tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] 10.222.0.36 "GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6" status: 200 len: 1259 microversion: 2.1 time: 0.727157 Jul 05 13:04:10.617377 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 230/452] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:04:09 2022] GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6 => generated 1259 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:04:10.721230 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-c12367f4-868d-406d-bdbd-cbe89890b9e1 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:10.721863 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-c12367f4-868d-406d-bdbd-cbe89890b9e1 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:10.733014 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c12367f4-868d-406d-bdbd-cbe89890b9e1 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:10.733683 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c12367f4-868d-406d-bdbd-cbe89890b9e1 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:10.735654 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c12367f4-868d-406d-bdbd-cbe89890b9e1 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:10.737009 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c12367f4-868d-406d-bdbd-cbe89890b9e1 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:11.058052 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-c12367f4-868d-406d-bdbd-cbe89890b9e1 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:11.060717 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell1:SELECT=100 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:04:11.069174 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-c12367f4-868d-406d-bdbd-cbe89890b9e1 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:11.077224 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-c12367f4-868d-406d-bdbd-cbe89890b9e1 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:11.078722 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-c12367f4-868d-406d-bdbd-cbe89890b9e1 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1809 microversion: 2.20 time: 0.361536 Jul 05 13:04:11.079888 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 223/453] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:04:10 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1809 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:04:11.138188 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-b68559ee-4159-4a53-8ee2-8ea6dbb20734 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:11.139154 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-b68559ee-4159-4a53-8ee2-8ea6dbb20734 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] [instance: 058a9566-8f0f-4920-b435-22ea5bee15e7] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:11.154287 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b68559ee-4159-4a53-8ee2-8ea6dbb20734 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:11.155229 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b68559ee-4159-4a53-8ee2-8ea6dbb20734 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:11.159044 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b68559ee-4159-4a53-8ee2-8ea6dbb20734 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:11.159491 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b68559ee-4159-4a53-8ee2-8ea6dbb20734 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:11.436060 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-b68559ee-4159-4a53-8ee2-8ea6dbb20734 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4a4bd26db664e44850f5ebccd838315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380379df1d7e4ebe90c75bcefecbc787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:11.448308 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-b68559ee-4159-4a53-8ee2-8ea6dbb20734 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] 10.222.0.36 "GET /compute/v2.1/servers/058a9566-8f0f-4920-b435-22ea5bee15e7" status: 200 len: 1314 microversion: 2.1 time: 0.318416 Jul 05 13:04:11.450193 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 231/454] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:04:11 2022] GET /compute/v2.1/servers/058a9566-8f0f-4920-b435-22ea5bee15e7 => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:04:11.635014 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-93bd68c1-c5b9-465a-9898-69615fc7a685 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:11.636062 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-93bd68c1-c5b9-465a-9898-69615fc7a685 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] [instance: 58708391-4350-4b7e-8616-f3f3534bd2e6] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:11.649928 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-93bd68c1-c5b9-465a-9898-69615fc7a685 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:11.650679 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-93bd68c1-c5b9-465a-9898-69615fc7a685 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:11.653466 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-93bd68c1-c5b9-465a-9898-69615fc7a685 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:11.655471 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-93bd68c1-c5b9-465a-9898-69615fc7a685 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:11.927325 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [req-e6d723f1-80f4-4d5d-8584-56782dde2d90 req-2956a061-9bb7-4550-b94e-de0df54e67d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b7f15b2-a00e-4172-983d-f2a80401953b", "tag": "31d1ed43-9fb9-4a56-aa9d-2fb0657cefdc"}]} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:04:11.943704 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-e6d723f1-80f4-4d5d-8584-56782dde2d90 req-2956a061-9bb7-4550-b94e-de0df54e67d4 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:11.944132 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-e6d723f1-80f4-4d5d-8584-56782dde2d90 req-2956a061-9bb7-4550-b94e-de0df54e67d4 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:11.976962 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-93bd68c1-c5b9-465a-9898-69615fc7a685 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf000835f1f48cca0a46b233e52c8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec699c3dd1ab470c8cc0685e6e9f766a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:11.991354 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.compute.server_external_events [req-e6d723f1-80f4-4d5d-8584-56782dde2d90 req-2956a061-9bb7-4550-b94e-de0df54e67d4 service nova] Creating event network-changed:31d1ed43-9fb9-4a56-aa9d-2fb0657cefdc for instance 7b7f15b2-a00e-4172-983d-f2a80401953b on hv-cinder-79760 Jul 05 13:04:11.994797 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-93bd68c1-c5b9-465a-9898-69615fc7a685 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] 10.222.0.36 "GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6" status: 200 len: 1259 microversion: 2.1 time: 0.354903 Jul 05 13:04:11.995467 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 224/455] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:04:11 2022] GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6 => generated 1259 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:04:12.013230 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [req-e6d723f1-80f4-4d5d-8584-56782dde2d90 req-2956a061-9bb7-4550-b94e-de0df54e67d4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089582 Jul 05 13:04:12.014389 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 232/456] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:04:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 13:04:12.102498 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-5201e832-07f7-40b9-8c7b-8a334128f63d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:12.103237 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-5201e832-07f7-40b9-8c7b-8a334128f63d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:12.121932 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5201e832-07f7-40b9-8c7b-8a334128f63d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:12.122078 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5201e832-07f7-40b9-8c7b-8a334128f63d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:12.122858 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5201e832-07f7-40b9-8c7b-8a334128f63d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:12.123308 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5201e832-07f7-40b9-8c7b-8a334128f63d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:12.467450 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-93b7c771-be07-4700-87ee-a7aaa12dfed3 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:12.468303 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-93b7c771-be07-4700-87ee-a7aaa12dfed3 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] [instance: 058a9566-8f0f-4920-b435-22ea5bee15e7] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:12.480151 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-93b7c771-be07-4700-87ee-a7aaa12dfed3 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:12.482761 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-93b7c771-be07-4700-87ee-a7aaa12dfed3 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:12.483985 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-93b7c771-be07-4700-87ee-a7aaa12dfed3 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:12.485412 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-93b7c771-be07-4700-87ee-a7aaa12dfed3 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:12.621516 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-5201e832-07f7-40b9-8c7b-8a334128f63d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:12.641829 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-5201e832-07f7-40b9-8c7b-8a334128f63d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:12.654988 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-5201e832-07f7-40b9-8c7b-8a334128f63d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:12.674853 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-5201e832-07f7-40b9-8c7b-8a334128f63d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1809 microversion: 2.20 time: 0.562001 Jul 05 13:04:12.677253 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 225/457] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:04:12 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1809 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:04:12.938001 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-93b7c771-be07-4700-87ee-a7aaa12dfed3 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4a4bd26db664e44850f5ebccd838315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380379df1d7e4ebe90c75bcefecbc787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:12.952696 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-93b7c771-be07-4700-87ee-a7aaa12dfed3 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] 10.222.0.36 "GET /compute/v2.1/servers/058a9566-8f0f-4920-b435-22ea5bee15e7" status: 200 len: 1499 microversion: 2.1 time: 0.489447 Jul 05 13:04:12.954515 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 233/458] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:04:12 2022] GET /compute/v2.1/servers/058a9566-8f0f-4920-b435-22ea5bee15e7 => generated 1499 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:04:13.018153 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-e497ee67-0967-42db-9f6f-d7199472b635 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:13.019447 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-e497ee67-0967-42db-9f6f-d7199472b635 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] [instance: 58708391-4350-4b7e-8616-f3f3534bd2e6] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:13.031426 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e497ee67-0967-42db-9f6f-d7199472b635 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:13.032128 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e497ee67-0967-42db-9f6f-d7199472b635 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:13.033245 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e497ee67-0967-42db-9f6f-d7199472b635 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:13.033924 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e497ee67-0967-42db-9f6f-d7199472b635 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:13.411309 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-e497ee67-0967-42db-9f6f-d7199472b635 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf000835f1f48cca0a46b233e52c8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec699c3dd1ab470c8cc0685e6e9f766a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:13.422938 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-e497ee67-0967-42db-9f6f-d7199472b635 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] 10.222.0.36 "GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6" status: 200 len: 1259 microversion: 2.1 time: 0.411218 Jul 05 13:04:13.426273 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 226/459] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:04:13 2022] GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6 => generated 1259 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:04:13.695896 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-b9b43087-bd53-48e7-84a0-26bec6f23786 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:13.697800 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-b9b43087-bd53-48e7-84a0-26bec6f23786 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:13.714530 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b9b43087-bd53-48e7-84a0-26bec6f23786 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:13.715423 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b9b43087-bd53-48e7-84a0-26bec6f23786 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:13.726092 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b9b43087-bd53-48e7-84a0-26bec6f23786 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:13.728214 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b9b43087-bd53-48e7-84a0-26bec6f23786 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:14.305564 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-91f66dcd-b984-49bd-9690-a7b88c7b6f22 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:14.309091 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-91f66dcd-b984-49bd-9690-a7b88c7b6f22 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] [instance: 058a9566-8f0f-4920-b435-22ea5bee15e7] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:14.342044 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-91f66dcd-b984-49bd-9690-a7b88c7b6f22 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:14.342924 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-91f66dcd-b984-49bd-9690-a7b88c7b6f22 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:14.345984 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-91f66dcd-b984-49bd-9690-a7b88c7b6f22 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:14.346767 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-91f66dcd-b984-49bd-9690-a7b88c7b6f22 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:14.419354 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-91f66dcd-b984-49bd-9690-a7b88c7b6f22 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] [instance: 058a9566-8f0f-4920-b435-22ea5bee15e7] Going to try to terminate instance {{(pid=118387) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 13:04:14.503316 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-b9b43087-bd53-48e7-84a0-26bec6f23786 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:14.517112 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-b9b43087-bd53-48e7-84a0-26bec6f23786 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:14.519209 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-b9b43087-bd53-48e7-84a0-26bec6f23786 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:14.521786 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-b9b43087-bd53-48e7-84a0-26bec6f23786 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1809 microversion: 2.20 time: 0.830257 Jul 05 13:04:14.536343 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 234/460] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:04:13 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1809 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:04:14.544115 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-1229f9ee-bd4f-45dd-9e8d-41768404ad37 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:14.545444 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-1229f9ee-bd4f-45dd-9e8d-41768404ad37 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] [instance: 58708391-4350-4b7e-8616-f3f3534bd2e6] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:14.553281 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-1229f9ee-bd4f-45dd-9e8d-41768404ad37 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:14.554559 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-1229f9ee-bd4f-45dd-9e8d-41768404ad37 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:14.556340 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-1229f9ee-bd4f-45dd-9e8d-41768404ad37 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:14.558167 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-1229f9ee-bd4f-45dd-9e8d-41768404ad37 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:14.742117 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-1229f9ee-bd4f-45dd-9e8d-41768404ad37 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf000835f1f48cca0a46b233e52c8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec699c3dd1ab470c8cc0685e6e9f766a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:14.754732 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-1229f9ee-bd4f-45dd-9e8d-41768404ad37 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] 10.222.0.36 "GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6" status: 200 len: 1259 microversion: 2.1 time: 0.212973 Jul 05 13:04:14.755354 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 235/461] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:04:14 2022] GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6 => generated 1259 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:04:14.883542 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-91f66dcd-b984-49bd-9690-a7b88c7b6f22 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] 10.222.0.36 "DELETE /compute/v2.1/servers/058a9566-8f0f-4920-b435-22ea5bee15e7" status: 204 len: 0 microversion: 2.1 time: 0.582247 Jul 05 13:04:14.884134 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 227/462] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jul 5 13:04:14 2022] DELETE /compute/v2.1/servers/058a9566-8f0f-4920-b435-22ea5bee15e7 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 05 13:04:14.893484 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-8e019691-a176-4e38-b238-6c8b38320b78 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:14.894811 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-8e019691-a176-4e38-b238-6c8b38320b78 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] [instance: 058a9566-8f0f-4920-b435-22ea5bee15e7] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:14.921781 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-8e019691-a176-4e38-b238-6c8b38320b78 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:14.922409 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-8e019691-a176-4e38-b238-6c8b38320b78 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:14.923736 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-8e019691-a176-4e38-b238-6c8b38320b78 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:14.924297 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-8e019691-a176-4e38-b238-6c8b38320b78 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:14.930831 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_cell1:SELECT=100 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:04:15.197548 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-8e019691-a176-4e38-b238-6c8b38320b78 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4a4bd26db664e44850f5ebccd838315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380379df1d7e4ebe90c75bcefecbc787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:15.207666 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-8e019691-a176-4e38-b238-6c8b38320b78 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] 10.222.0.36 "GET /compute/v2.1/servers/058a9566-8f0f-4920-b435-22ea5bee15e7" status: 200 len: 1505 microversion: 2.1 time: 0.318410 Jul 05 13:04:15.208275 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 236/463] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:04:14 2022] GET /compute/v2.1/servers/058a9566-8f0f-4920-b435-22ea5bee15e7 => generated 1505 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:04:15.542604 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-4c066565-7652-44df-b1e5-cff54f51a93c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:15.543849 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-4c066565-7652-44df-b1e5-cff54f51a93c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:15.552074 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4c066565-7652-44df-b1e5-cff54f51a93c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:15.553425 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4c066565-7652-44df-b1e5-cff54f51a93c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:15.554550 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4c066565-7652-44df-b1e5-cff54f51a93c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:15.555139 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4c066565-7652-44df-b1e5-cff54f51a93c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:15.774497 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-921544ac-1c19-4201-a4f0-392e0027fb20 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:15.775114 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-921544ac-1c19-4201-a4f0-392e0027fb20 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] [instance: 58708391-4350-4b7e-8616-f3f3534bd2e6] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:15.778303 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-4c066565-7652-44df-b1e5-cff54f51a93c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:15.788967 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-921544ac-1c19-4201-a4f0-392e0027fb20 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:15.789634 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-921544ac-1c19-4201-a4f0-392e0027fb20 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:15.790822 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-921544ac-1c19-4201-a4f0-392e0027fb20 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:15.792199 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-921544ac-1c19-4201-a4f0-392e0027fb20 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:15.815701 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-4c066565-7652-44df-b1e5-cff54f51a93c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:15.818978 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-4c066565-7652-44df-b1e5-cff54f51a93c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:15.823545 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-4c066565-7652-44df-b1e5-cff54f51a93c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1809 microversion: 2.20 time: 0.285351 Jul 05 13:04:15.833599 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 228/464] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:04:15 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1809 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:04:16.096676 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-921544ac-1c19-4201-a4f0-392e0027fb20 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf000835f1f48cca0a46b233e52c8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec699c3dd1ab470c8cc0685e6e9f766a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:16.116281 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-921544ac-1c19-4201-a4f0-392e0027fb20 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] 10.222.0.36 "GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6" status: 200 len: 1259 microversion: 2.1 time: 0.347777 Jul 05 13:04:16.131014 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 237/465] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:04:15 2022] GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6 => generated 1259 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:04:16.226883 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-d30aa4dc-074f-459e-ab00-7ef353438b49 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:16.227822 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-d30aa4dc-074f-459e-ab00-7ef353438b49 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] [instance: 058a9566-8f0f-4920-b435-22ea5bee15e7] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:16.241153 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d30aa4dc-074f-459e-ab00-7ef353438b49 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:16.243905 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d30aa4dc-074f-459e-ab00-7ef353438b49 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:16.244805 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d30aa4dc-074f-459e-ab00-7ef353438b49 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:16.245438 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d30aa4dc-074f-459e-ab00-7ef353438b49 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:16.654234 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-d30aa4dc-074f-459e-ab00-7ef353438b49 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4a4bd26db664e44850f5ebccd838315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380379df1d7e4ebe90c75bcefecbc787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:16.668304 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-d30aa4dc-074f-459e-ab00-7ef353438b49 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] 10.222.0.36 "GET /compute/v2.1/servers/058a9566-8f0f-4920-b435-22ea5bee15e7" status: 200 len: 1505 microversion: 2.1 time: 0.446617 Jul 05 13:04:16.668926 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 229/466] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:04:16 2022] GET /compute/v2.1/servers/058a9566-8f0f-4920-b435-22ea5bee15e7 => generated 1505 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:04:16.850532 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-24578f25-3d5a-4afc-b4cb-71092f2160f3 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:16.853542 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-24578f25-3d5a-4afc-b4cb-71092f2160f3 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:16.858743 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-24578f25-3d5a-4afc-b4cb-71092f2160f3 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:16.865249 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-24578f25-3d5a-4afc-b4cb-71092f2160f3 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:16.866572 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-24578f25-3d5a-4afc-b4cb-71092f2160f3 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:16.880323 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-24578f25-3d5a-4afc-b4cb-71092f2160f3 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:17.102995 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-24578f25-3d5a-4afc-b4cb-71092f2160f3 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:17.121742 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-24578f25-3d5a-4afc-b4cb-71092f2160f3 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:17.123263 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-24578f25-3d5a-4afc-b4cb-71092f2160f3 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:17.124493 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-24578f25-3d5a-4afc-b4cb-71092f2160f3 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1809 microversion: 2.20 time: 0.278023 Jul 05 13:04:17.136464 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-7eda9367-0124-4902-b575-c65513a41234 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:17.137305 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-7eda9367-0124-4902-b575-c65513a41234 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] [instance: 58708391-4350-4b7e-8616-f3f3534bd2e6] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:17.144456 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 238/467] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:04:16 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1809 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:04:17.149659 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7eda9367-0124-4902-b575-c65513a41234 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:17.150390 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7eda9367-0124-4902-b575-c65513a41234 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:17.151383 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7eda9367-0124-4902-b575-c65513a41234 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:17.152031 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7eda9367-0124-4902-b575-c65513a41234 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:17.355012 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-7eda9367-0124-4902-b575-c65513a41234 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf000835f1f48cca0a46b233e52c8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec699c3dd1ab470c8cc0685e6e9f766a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:17.366358 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-7eda9367-0124-4902-b575-c65513a41234 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] 10.222.0.36 "GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6" status: 200 len: 1259 microversion: 2.1 time: 0.234760 Jul 05 13:04:17.367330 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 230/468] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:04:17 2022] GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6 => generated 1259 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:04:17.643713 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [req-e726afb5-602a-423e-86ef-8311bbb952a7 req-e112c861-e15f-432c-9e26-913b2484b73e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58708391-4350-4b7e-8616-f3f3534bd2e6", "name": "network-vif-plugged", "status": "completed", "tag": "dea25a3b-1daa-482f-9f40-46b326121051"}]} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:04:17.661053 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-e726afb5-602a-423e-86ef-8311bbb952a7 req-e112c861-e15f-432c-9e26-913b2484b73e service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:17.661547 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-e726afb5-602a-423e-86ef-8311bbb952a7 req-e112c861-e15f-432c-9e26-913b2484b73e service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:17.676487 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.compute.server_external_events [req-e726afb5-602a-423e-86ef-8311bbb952a7 req-e112c861-e15f-432c-9e26-913b2484b73e service nova] Creating event network-vif-plugged:dea25a3b-1daa-482f-9f40-46b326121051 for instance 58708391-4350-4b7e-8616-f3f3534bd2e6 on hv-cinder-79760 Jul 05 13:04:17.686433 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-c6258ebe-d074-4775-a2af-0a06be4209fa tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:17.687812 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-c6258ebe-d074-4775-a2af-0a06be4209fa tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] [instance: 058a9566-8f0f-4920-b435-22ea5bee15e7] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:17.688965 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [req-e726afb5-602a-423e-86ef-8311bbb952a7 req-e112c861-e15f-432c-9e26-913b2484b73e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048816 Jul 05 13:04:17.692984 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 239/469] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:04:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:04:17.699612 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c6258ebe-d074-4775-a2af-0a06be4209fa tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:17.700462 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c6258ebe-d074-4775-a2af-0a06be4209fa tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:17.701545 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c6258ebe-d074-4775-a2af-0a06be4209fa tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:17.702058 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c6258ebe-d074-4775-a2af-0a06be4209fa tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:18.108192 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-c6258ebe-d074-4775-a2af-0a06be4209fa tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4a4bd26db664e44850f5ebccd838315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380379df1d7e4ebe90c75bcefecbc787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:18.123179 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-c6258ebe-d074-4775-a2af-0a06be4209fa tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] 10.222.0.36 "GET /compute/v2.1/servers/058a9566-8f0f-4920-b435-22ea5bee15e7" status: 200 len: 1505 microversion: 2.1 time: 0.441189 Jul 05 13:04:18.123765 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 231/470] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:04:17 2022] GET /compute/v2.1/servers/058a9566-8f0f-4920-b435-22ea5bee15e7 => generated 1505 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:04:18.154012 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-96fc96ee-51ce-4da0-9d69-55b9c0843f71 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:18.154719 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-96fc96ee-51ce-4da0-9d69-55b9c0843f71 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:18.162514 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-96fc96ee-51ce-4da0-9d69-55b9c0843f71 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:18.163234 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-96fc96ee-51ce-4da0-9d69-55b9c0843f71 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:18.164340 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-96fc96ee-51ce-4da0-9d69-55b9c0843f71 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:18.165102 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-96fc96ee-51ce-4da0-9d69-55b9c0843f71 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:18.383831 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-b7b0000d-ec51-4645-91a8-1fb224b194e1 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:18.384472 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-b7b0000d-ec51-4645-91a8-1fb224b194e1 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] [instance: 58708391-4350-4b7e-8616-f3f3534bd2e6] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:18.393077 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b7b0000d-ec51-4645-91a8-1fb224b194e1 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:18.393536 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b7b0000d-ec51-4645-91a8-1fb224b194e1 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:18.396782 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b7b0000d-ec51-4645-91a8-1fb224b194e1 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:18.397230 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b7b0000d-ec51-4645-91a8-1fb224b194e1 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:18.670030 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-96fc96ee-51ce-4da0-9d69-55b9c0843f71 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:18.696217 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-96fc96ee-51ce-4da0-9d69-55b9c0843f71 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:18.697770 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-96fc96ee-51ce-4da0-9d69-55b9c0843f71 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:18.699216 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-96fc96ee-51ce-4da0-9d69-55b9c0843f71 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1809 microversion: 2.20 time: 0.550524 Jul 05 13:04:18.710527 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 240/471] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:04:18 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1809 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:04:18.807958 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-b7b0000d-ec51-4645-91a8-1fb224b194e1 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf000835f1f48cca0a46b233e52c8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec699c3dd1ab470c8cc0685e6e9f766a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:18.833890 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-b7b0000d-ec51-4645-91a8-1fb224b194e1 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] 10.222.0.36 "GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6" status: 200 len: 1259 microversion: 2.1 time: 0.453694 Jul 05 13:04:18.835089 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 232/472] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:04:18 2022] GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6 => generated 1259 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:04:19.141049 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-d48f7aa9-98d1-4dd5-92da-9f512a36cf6a tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:19.148118 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-d48f7aa9-98d1-4dd5-92da-9f512a36cf6a tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] [instance: 058a9566-8f0f-4920-b435-22ea5bee15e7] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:19.153342 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-d48f7aa9-98d1-4dd5-92da-9f512a36cf6a tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:19.153968 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-d48f7aa9-98d1-4dd5-92da-9f512a36cf6a tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:19.154626 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-d48f7aa9-98d1-4dd5-92da-9f512a36cf6a tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:19.167376 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-d48f7aa9-98d1-4dd5-92da-9f512a36cf6a tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:19.518593 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-d48f7aa9-98d1-4dd5-92da-9f512a36cf6a tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4a4bd26db664e44850f5ebccd838315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380379df1d7e4ebe90c75bcefecbc787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:19.533081 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-d48f7aa9-98d1-4dd5-92da-9f512a36cf6a tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] 10.222.0.36 "GET /compute/v2.1/servers/058a9566-8f0f-4920-b435-22ea5bee15e7" status: 200 len: 1505 microversion: 2.1 time: 0.395958 Jul 05 13:04:19.534070 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 241/473] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:04:19 2022] GET /compute/v2.1/servers/058a9566-8f0f-4920-b435-22ea5bee15e7 => generated 1505 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:04:19.721055 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-b98abd62-acfc-4246-8464-458597bec810 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:19.721651 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-b98abd62-acfc-4246-8464-458597bec810 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:19.733064 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:04:19.743976 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b98abd62-acfc-4246-8464-458597bec810 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:19.746666 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b98abd62-acfc-4246-8464-458597bec810 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:19.750060 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b98abd62-acfc-4246-8464-458597bec810 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:19.752450 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b98abd62-acfc-4246-8464-458597bec810 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:19.865493 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-e1ab7425-44f0-448a-8d06-0f0b1fb84412 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:19.867607 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-e1ab7425-44f0-448a-8d06-0f0b1fb84412 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] [instance: 58708391-4350-4b7e-8616-f3f3534bd2e6] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:19.891029 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e1ab7425-44f0-448a-8d06-0f0b1fb84412 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:19.891528 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e1ab7425-44f0-448a-8d06-0f0b1fb84412 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:19.892384 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e1ab7425-44f0-448a-8d06-0f0b1fb84412 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:19.892839 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e1ab7425-44f0-448a-8d06-0f0b1fb84412 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:20.146132 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-b98abd62-acfc-4246-8464-458597bec810 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:20.160970 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-e1ab7425-44f0-448a-8d06-0f0b1fb84412 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf000835f1f48cca0a46b233e52c8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec699c3dd1ab470c8cc0685e6e9f766a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:20.168477 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-b98abd62-acfc-4246-8464-458597bec810 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:20.173063 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-e1ab7425-44f0-448a-8d06-0f0b1fb84412 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] 10.222.0.36 "GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6" status: 200 len: 1259 microversion: 2.1 time: 0.324113 Jul 05 13:04:20.175194 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 242/474] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:04:19 2022] GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6 => generated 1259 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:04:20.181254 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-b98abd62-acfc-4246-8464-458597bec810 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:20.182456 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-b98abd62-acfc-4246-8464-458597bec810 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1809 microversion: 2.20 time: 0.468619 Jul 05 13:04:20.187517 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 233/475] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:04:19 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1809 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:04:20.553014 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-f860df9a-101b-48f1-9617-339004ab64ca tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:20.553732 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-f860df9a-101b-48f1-9617-339004ab64ca tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] [instance: 058a9566-8f0f-4920-b435-22ea5bee15e7] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:20.566674 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f860df9a-101b-48f1-9617-339004ab64ca tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:20.580985 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f860df9a-101b-48f1-9617-339004ab64ca tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:20.580985 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f860df9a-101b-48f1-9617-339004ab64ca tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:20.580985 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f860df9a-101b-48f1-9617-339004ab64ca tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:20.589463 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-d8022154-3932-4e36-9df5-9018c8849ee5 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Action: 'create', calling method: .version_select at 0x7f70de9d6c10>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1066638790", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBETAewczRCSB6ZNmyjx2chQ8dwAbHHzfb03k7xaAgXDouREHqAtv3GSLL/iMMEoDvMHkQm3lHc8IRu7aRRJisjGpQ8Vf/ySSkuHjcU0kQDM6yVKeQlfXcPD2GgkvUM7ffg=="}} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:04:20.636099 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.quota [None req-d8022154-3932-4e36-9df5-9018c8849ee5 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Getting quotas for project 277fa3c89dff47b88894b781ff69fb70. Resources: {'key_pairs'} {{(pid=118386) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 13:04:20.652949 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.quota [None req-d8022154-3932-4e36-9df5-9018c8849ee5 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Getting quotas for user 661062780f5c45d180a05e402fc7bc27 and project 277fa3c89dff47b88894b781ff69fb70. Resources: {'key_pairs'} {{(pid=118386) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 13:04:20.684161 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d8022154-3932-4e36-9df5-9018c8849ee5 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [16b41bad-c7a3-474c-a95b-9bf73b75b779] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 05 13:04:20.787000 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-f860df9a-101b-48f1-9617-339004ab64ca tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4a4bd26db664e44850f5ebccd838315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380379df1d7e4ebe90c75bcefecbc787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:20.804822 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-f860df9a-101b-48f1-9617-339004ab64ca tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] 10.222.0.36 "GET /compute/v2.1/servers/058a9566-8f0f-4920-b435-22ea5bee15e7" status: 200 len: 1463 microversion: 2.1 time: 0.256776 Jul 05 13:04:20.806173 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 234/476] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:04:20 2022] GET /compute/v2.1/servers/058a9566-8f0f-4920-b435-22ea5bee15e7 => generated 1463 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:04:20.822106 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-e90064ae-71ea-446f-bbd0-66860945976d req-ee955d87-8c35-419c-920a-d7ec9d5f2c4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "058a9566-8f0f-4920-b435-22ea5bee15e7", "name": "network-vif-deleted", "tag": "e7af3335-2286-40b5-bde4-70b80fbc82bd"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:04:20.847760 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-e90064ae-71ea-446f-bbd0-66860945976d req-ee955d87-8c35-419c-920a-d7ec9d5f2c4b service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:20.851129 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-e90064ae-71ea-446f-bbd0-66860945976d req-ee955d87-8c35-419c-920a-d7ec9d5f2c4b service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:20.874035 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-e90064ae-71ea-446f-bbd0-66860945976d req-ee955d87-8c35-419c-920a-d7ec9d5f2c4b service nova] Creating event network-vif-deleted:e7af3335-2286-40b5-bde4-70b80fbc82bd for instance 058a9566-8f0f-4920-b435-22ea5bee15e7 on hv-cinder-79760 Jul 05 13:04:20.876617 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-e90064ae-71ea-446f-bbd0-66860945976d req-ee955d87-8c35-419c-920a-d7ec9d5f2c4b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069101 Jul 05 13:04:20.877580 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 235/477] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:04:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:04:21.192752 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-b2d82272-ba90-4420-8948-0c2ece57ce7a tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:21.194133 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-b2d82272-ba90-4420-8948-0c2ece57ce7a tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] [instance: 58708391-4350-4b7e-8616-f3f3534bd2e6] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:21.200897 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b2d82272-ba90-4420-8948-0c2ece57ce7a tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:21.201756 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b2d82272-ba90-4420-8948-0c2ece57ce7a tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:21.202709 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b2d82272-ba90-4420-8948-0c2ece57ce7a tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:21.203302 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b2d82272-ba90-4420-8948-0c2ece57ce7a tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:21.349177 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-b2d82272-ba90-4420-8948-0c2ece57ce7a tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf000835f1f48cca0a46b233e52c8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec699c3dd1ab470c8cc0685e6e9f766a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:21.357561 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-b2d82272-ba90-4420-8948-0c2ece57ce7a tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] 10.222.0.36 "GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6" status: 200 len: 1259 microversion: 2.1 time: 0.169901 Jul 05 13:04:21.358313 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 236/478] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:04:21 2022] GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6 => generated 1259 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:04:21.363089 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-285308e1-eefa-432d-a4ec-0a3203869b23 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:21.363874 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-285308e1-eefa-432d-a4ec-0a3203869b23 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:21.369800 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-285308e1-eefa-432d-a4ec-0a3203869b23 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:21.370255 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-285308e1-eefa-432d-a4ec-0a3203869b23 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:21.371017 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-285308e1-eefa-432d-a4ec-0a3203869b23 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:21.371619 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-285308e1-eefa-432d-a4ec-0a3203869b23 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:21.545037 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-285308e1-eefa-432d-a4ec-0a3203869b23 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:21.562736 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-285308e1-eefa-432d-a4ec-0a3203869b23 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:21.568491 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-285308e1-eefa-432d-a4ec-0a3203869b23 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:21.570004 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-285308e1-eefa-432d-a4ec-0a3203869b23 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1809 microversion: 2.20 time: 0.210557 Jul 05 13:04:21.570970 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 237/479] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:04:21 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1809 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:04:21.693469 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO oslo.messaging._drivers.impl_rabbit [None req-d8022154-3932-4e36-9df5-9018c8849ee5 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [16b41bad-c7a3-474c-a95b-9bf73b75b779] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 37504. Jul 05 13:04:21.808000 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-d8022154-3932-4e36-9df5-9018c8849ee5 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 1.631035 Jul 05 13:04:21.808773 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 243/480] 10.222.0.36 () {60 vars in 1158 bytes} [Tue Jul 5 13:04:20 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1633 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:04:21.829846 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-2e63d003-5385-495a-924e-227cf8488385 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:21.830802 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-2e63d003-5385-495a-924e-227cf8488385 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] [instance: 058a9566-8f0f-4920-b435-22ea5bee15e7] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:21.842998 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2e63d003-5385-495a-924e-227cf8488385 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:21.846408 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2e63d003-5385-495a-924e-227cf8488385 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:21.846408 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2e63d003-5385-495a-924e-227cf8488385 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:21.846408 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2e63d003-5385-495a-924e-227cf8488385 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:21.955089 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-2e63d003-5385-495a-924e-227cf8488385 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4a4bd26db664e44850f5ebccd838315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380379df1d7e4ebe90c75bcefecbc787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:21.963392 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-2e63d003-5385-495a-924e-227cf8488385 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] 10.222.0.36 "GET /compute/v2.1/servers/058a9566-8f0f-4920-b435-22ea5bee15e7" status: 200 len: 1299 microversion: 2.1 time: 0.138250 Jul 05 13:04:21.985467 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 238/481] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:04:21 2022] GET /compute/v2.1/servers/058a9566-8f0f-4920-b435-22ea5bee15e7 => generated 1299 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:04:22.374515 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-97176616-d7cb-48cf-b0db-51215b5bd920 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:22.375137 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-97176616-d7cb-48cf-b0db-51215b5bd920 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] [instance: 58708391-4350-4b7e-8616-f3f3534bd2e6] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:22.388213 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-97176616-d7cb-48cf-b0db-51215b5bd920 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:22.388874 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-97176616-d7cb-48cf-b0db-51215b5bd920 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:22.389712 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-97176616-d7cb-48cf-b0db-51215b5bd920 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:22.390154 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-97176616-d7cb-48cf-b0db-51215b5bd920 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:22.589227 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-7b831347-070a-45b1-a144-03d482a4c2ff tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:22.590612 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-7b831347-070a-45b1-a144-03d482a4c2ff tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:22.601157 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7b831347-070a-45b1-a144-03d482a4c2ff tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:22.604381 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7b831347-070a-45b1-a144-03d482a4c2ff tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:22.607443 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7b831347-070a-45b1-a144-03d482a4c2ff tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:22.608906 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7b831347-070a-45b1-a144-03d482a4c2ff tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:22.642153 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:04:23.148609 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-97176616-d7cb-48cf-b0db-51215b5bd920 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf000835f1f48cca0a46b233e52c8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec699c3dd1ab470c8cc0685e6e9f766a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:23.158641 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-97176616-d7cb-48cf-b0db-51215b5bd920 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] 10.222.0.36 "GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6" status: 200 len: 1259 microversion: 2.1 time: 0.787815 Jul 05 13:04:23.160932 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 244/482] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:04:22 2022] GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6 => generated 1259 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:04:23.186159 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-f60b1c98-a373-4f18-b459-7421ebce1270 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:23.189908 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-f60b1c98-a373-4f18-b459-7421ebce1270 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] [instance: 058a9566-8f0f-4920-b435-22ea5bee15e7] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:23.203460 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f60b1c98-a373-4f18-b459-7421ebce1270 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:23.204988 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f60b1c98-a373-4f18-b459-7421ebce1270 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:23.206154 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f60b1c98-a373-4f18-b459-7421ebce1270 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:23.207378 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f60b1c98-a373-4f18-b459-7421ebce1270 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:23.230680 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-7b831347-070a-45b1-a144-03d482a4c2ff tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:23.243024 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-7b831347-070a-45b1-a144-03d482a4c2ff tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:23.244822 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-7b831347-070a-45b1-a144-03d482a4c2ff tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:23.246962 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-7b831347-070a-45b1-a144-03d482a4c2ff tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1809 microversion: 2.20 time: 0.661625 Jul 05 13:04:23.248221 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 239/483] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:04:22 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1809 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 13:04:23.359862 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-f60b1c98-a373-4f18-b459-7421ebce1270 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4a4bd26db664e44850f5ebccd838315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380379df1d7e4ebe90c75bcefecbc787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:23.380377 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-f60b1c98-a373-4f18-b459-7421ebce1270 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] 10.222.0.36 "GET /compute/v2.1/servers/058a9566-8f0f-4920-b435-22ea5bee15e7" status: 200 len: 1299 microversion: 2.1 time: 0.217357 Jul 05 13:04:23.389207 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 245/484] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:04:23 2022] GET /compute/v2.1/servers/058a9566-8f0f-4920-b435-22ea5bee15e7 => generated 1299 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:04:24.182918 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-c93ff79b-1c5b-4e19-bffd-d8000951be41 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:24.183831 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-c93ff79b-1c5b-4e19-bffd-d8000951be41 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] [instance: 58708391-4350-4b7e-8616-f3f3534bd2e6] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:24.194645 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c93ff79b-1c5b-4e19-bffd-d8000951be41 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:24.195358 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c93ff79b-1c5b-4e19-bffd-d8000951be41 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:24.196178 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c93ff79b-1c5b-4e19-bffd-d8000951be41 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:24.196679 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c93ff79b-1c5b-4e19-bffd-d8000951be41 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:24.267161 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-5c06f3c1-a032-4f0c-96ed-0dcdd4a490e4 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:24.268981 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-5c06f3c1-a032-4f0c-96ed-0dcdd4a490e4 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:24.277726 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-5c06f3c1-a032-4f0c-96ed-0dcdd4a490e4 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:24.278889 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-5c06f3c1-a032-4f0c-96ed-0dcdd4a490e4 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:24.280391 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-5c06f3c1-a032-4f0c-96ed-0dcdd4a490e4 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:24.281068 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-5c06f3c1-a032-4f0c-96ed-0dcdd4a490e4 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:24.451337 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-c93ff79b-1c5b-4e19-bffd-d8000951be41 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf000835f1f48cca0a46b233e52c8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec699c3dd1ab470c8cc0685e6e9f766a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:24.459827 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-c93ff79b-1c5b-4e19-bffd-d8000951be41 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] 10.222.0.36 "GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6" status: 200 len: 1444 microversion: 2.1 time: 0.281168 Jul 05 13:04:24.460402 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 240/485] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:04:24 2022] GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6 => generated 1444 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:04:24.475273 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-7d3860bb-3a75-4aef-9be3-55f8c2cefd60 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:24.476095 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-7d3860bb-3a75-4aef-9be3-55f8c2cefd60 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] [instance: 058a9566-8f0f-4920-b435-22ea5bee15e7] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:24.482540 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7d3860bb-3a75-4aef-9be3-55f8c2cefd60 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:24.482996 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7d3860bb-3a75-4aef-9be3-55f8c2cefd60 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:24.483779 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7d3860bb-3a75-4aef-9be3-55f8c2cefd60 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:24.484216 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7d3860bb-3a75-4aef-9be3-55f8c2cefd60 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:24.494334 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-5c06f3c1-a032-4f0c-96ed-0dcdd4a490e4 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:24.502917 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-5c06f3c1-a032-4f0c-96ed-0dcdd4a490e4 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:24.505143 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-5c06f3c1-a032-4f0c-96ed-0dcdd4a490e4 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:24.515442 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-5c06f3c1-a032-4f0c-96ed-0dcdd4a490e4 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1809 microversion: 2.20 time: 0.253227 Jul 05 13:04:24.516048 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 246/486] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:04:24 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1809 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:04:24.520883 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-8297ac34-0629-4274-ad74-756c1e523ad6 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:24.521501 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-8297ac34-0629-4274-ad74-756c1e523ad6 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] [instance: 58708391-4350-4b7e-8616-f3f3534bd2e6] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:24.540708 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-8297ac34-0629-4274-ad74-756c1e523ad6 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:24.541154 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-8297ac34-0629-4274-ad74-756c1e523ad6 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:24.541930 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-8297ac34-0629-4274-ad74-756c1e523ad6 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:24.542369 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-8297ac34-0629-4274-ad74-756c1e523ad6 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:24.553928 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7d3860bb-3a75-4aef-9be3-55f8c2cefd60 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:24.554475 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7d3860bb-3a75-4aef-9be3-55f8c2cefd60 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:24.554931 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.objects.instance [None req-7d3860bb-3a75-4aef-9be3-55f8c2cefd60 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lazy-loading 'fault' on Instance uuid 058a9566-8f0f-4920-b435-22ea5bee15e7 {{(pid=118387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 13:04:24.645900 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-7d3860bb-3a75-4aef-9be3-55f8c2cefd60 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4a4bd26db664e44850f5ebccd838315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380379df1d7e4ebe90c75bcefecbc787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:24.659070 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-7d3860bb-3a75-4aef-9be3-55f8c2cefd60 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] 10.222.0.36 "GET /compute/v2.1/servers/058a9566-8f0f-4920-b435-22ea5bee15e7" status: 200 len: 1304 microversion: 2.1 time: 0.187948 Jul 05 13:04:24.659823 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 241/487] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:04:24 2022] GET /compute/v2.1/servers/058a9566-8f0f-4920-b435-22ea5bee15e7 => generated 1304 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:04:24.721545 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-8297ac34-0629-4274-ad74-756c1e523ad6 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf000835f1f48cca0a46b233e52c8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec699c3dd1ab470c8cc0685e6e9f766a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:24.738601 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-8297ac34-0629-4274-ad74-756c1e523ad6 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] 10.222.0.36 "GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6" status: 200 len: 1444 microversion: 2.1 time: 0.214204 Jul 05 13:04:24.738601 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 247/488] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:04:24 2022] GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6 => generated 1444 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:04:25.535860 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-166475c9-a526-4930-aae1-09760793d5da tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:25.536473 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-166475c9-a526-4930-aae1-09760793d5da tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:25.543690 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-166475c9-a526-4930-aae1-09760793d5da tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:25.544132 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-166475c9-a526-4930-aae1-09760793d5da tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:25.545013 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-166475c9-a526-4930-aae1-09760793d5da tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:25.545450 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-166475c9-a526-4930-aae1-09760793d5da tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:25.680905 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-c900036e-9b77-45e1-a590-8fd5c0dc443a tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:25.693079 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-c900036e-9b77-45e1-a590-8fd5c0dc443a tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] [instance: 058a9566-8f0f-4920-b435-22ea5bee15e7] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:25.702143 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-c900036e-9b77-45e1-a590-8fd5c0dc443a tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:25.705041 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-c900036e-9b77-45e1-a590-8fd5c0dc443a tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:25.705920 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-c900036e-9b77-45e1-a590-8fd5c0dc443a tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:25.707013 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-c900036e-9b77-45e1-a590-8fd5c0dc443a tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:25.752485 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-166475c9-a526-4930-aae1-09760793d5da tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:25.764510 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-166475c9-a526-4930-aae1-09760793d5da tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:25.768201 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-c900036e-9b77-45e1-a590-8fd5c0dc443a tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:25.769486 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-c900036e-9b77-45e1-a590-8fd5c0dc443a tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:25.770118 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.objects.instance [None req-c900036e-9b77-45e1-a590-8fd5c0dc443a tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lazy-loading 'fault' on Instance uuid 058a9566-8f0f-4920-b435-22ea5bee15e7 {{(pid=118386) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 13:04:25.773629 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-166475c9-a526-4930-aae1-09760793d5da tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:25.774872 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-166475c9-a526-4930-aae1-09760793d5da tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1809 microversion: 2.20 time: 0.243580 Jul 05 13:04:25.775837 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 242/489] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:04:25 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1809 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:04:25.839070 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-c900036e-9b77-45e1-a590-8fd5c0dc443a tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4a4bd26db664e44850f5ebccd838315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380379df1d7e4ebe90c75bcefecbc787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:25.848323 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-c900036e-9b77-45e1-a590-8fd5c0dc443a tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] 10.222.0.36 "GET /compute/v2.1/servers/058a9566-8f0f-4920-b435-22ea5bee15e7" status: 200 len: 1304 microversion: 2.1 time: 0.175866 Jul 05 13:04:25.854603 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 248/490] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:04:25 2022] GET /compute/v2.1/servers/058a9566-8f0f-4920-b435-22ea5bee15e7 => generated 1304 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:04:26.793216 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-57328f4b-0813-4823-9300-6ccff3217070 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:26.793829 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-57328f4b-0813-4823-9300-6ccff3217070 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:26.801243 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-57328f4b-0813-4823-9300-6ccff3217070 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:26.802036 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-57328f4b-0813-4823-9300-6ccff3217070 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:26.802829 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-57328f4b-0813-4823-9300-6ccff3217070 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:26.803495 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-57328f4b-0813-4823-9300-6ccff3217070 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:26.870280 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-6d3e4d08-ff0c-4213-a046-6dbddd36a2d0 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:26.870280 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-6d3e4d08-ff0c-4213-a046-6dbddd36a2d0 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] [instance: 058a9566-8f0f-4920-b435-22ea5bee15e7] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:26.875883 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-6d3e4d08-ff0c-4213-a046-6dbddd36a2d0 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:26.876664 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-6d3e4d08-ff0c-4213-a046-6dbddd36a2d0 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:26.878292 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-6d3e4d08-ff0c-4213-a046-6dbddd36a2d0 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:26.878797 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-6d3e4d08-ff0c-4213-a046-6dbddd36a2d0 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:26.894514 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.wsgi [None req-6d3e4d08-ff0c-4213-a046-6dbddd36a2d0 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] HTTP exception thrown: Instance 058a9566-8f0f-4920-b435-22ea5bee15e7 could not be found. Jul 05 13:04:26.896898 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-6d3e4d08-ff0c-4213-a046-6dbddd36a2d0 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Request method failure captured: Jul 05 13:04:26.896898 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: request: GET /compute/v2.1/servers/058a9566-8f0f-4920-b435-22ea5bee15e7 HTTP/1.1 Jul 05 13:04:26.896898 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Accept: application/json Jul 05 13:04:26.896898 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Accept-Encoding: identity Jul 05 13:04:26.896898 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Connection: close Jul 05 13:04:26.896898 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Content-Length: 0 Jul 05 13:04:26.896898 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Content-Type: application/json Jul 05 13:04:26.896898 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Host: 10.222.0.36 Jul 05 13:04:26.896898 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Openstack-System-Scope: None Jul 05 13:04:26.896898 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: User-Agent: python-urllib3/1.26.9 Jul 05 13:04:26.896898 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Auth-Token: gAAAAABixDZ-_lja90p43bDO3L_ckPEmTL6OIpajOKTRKGMy2qmcTgUYWLdmGnOY8fF6Vm3IwvVlAGjDTpGOvVLf-0czv5sVp6fw_lU0Bz5qmF69upzCjGw1Nwvvk9oGmxyiKnCs0_r7WpHF-i6Ax2GS0qhMlqg_IX0b_IG5cFmDD37eFil6raI Jul 05 13:04:26.896898 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Domain-Id: None Jul 05 13:04:26.896898 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Domain-Name: None Jul 05 13:04:26.896898 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Identity-Status: Confirmed Jul 05 13:04:26.896898 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Is-Admin-Project: True Jul 05 13:04:26.896898 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Domain-Id: default Jul 05 13:04:26.896898 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Domain-Name: Default Jul 05 13:04:26.896898 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Id: 380379df1d7e4ebe90c75bcefecbc787 Jul 05 13:04:26.896898 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Name: tempest-VolumesActionsTest-616891412 Jul 05 13:04:26.896898 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Role: member,reader Jul 05 13:04:26.896898 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Roles: member,reader Jul 05 13:04:26.905326 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/380379df1d7e4ebe90c75bcefecbc787"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_380379df1d7e4ebe90c75bcefecbc787", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/380379df1d7e4ebe90c75bcefecbc787"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/380379df1d7e4ebe90c75bcefecbc787"}]}] Jul 05 13:04:26.905326 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Tenant: tempest-VolumesActionsTest-616891412 Jul 05 13:04:26.905326 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Tenant-Id: 380379df1d7e4ebe90c75bcefecbc787 Jul 05 13:04:26.905326 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Tenant-Name: tempest-VolumesActionsTest-616891412 Jul 05 13:04:26.905326 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User: tempest-VolumesActionsTest-616891412-project Jul 05 13:04:26.905326 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Domain-Id: default Jul 05 13:04:26.905326 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Domain-Name: Default Jul 05 13:04:26.905326 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Id: e4a4bd26db664e44850f5ebccd838315 Jul 05 13:04:26.905326 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Name: tempest-VolumesActionsTest-616891412-project Jul 05 13:04:26.905326 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: method: > Jul 05 13:04:26.905326 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: exception: Instance 058a9566-8f0f-4920-b435-22ea5bee15e7 could not be found. Jul 05 13:04:26.905326 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: action_args: {'id': '058a9566-8f0f-4920-b435-22ea5bee15e7'} Jul 05 13:04:26.906197 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 13:04:26.906197 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:04:26.906197 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 13:04:26.906197 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 13:04:26.906197 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 13:04:26.906197 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 13:04:26.906197 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 13:04:26.906197 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 13:04:26.906197 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 13:04:26.906197 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 13:04:26.906197 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 058a9566-8f0f-4920-b435-22ea5bee15e7 could not be found. Jul 05 13:04:26.906197 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:04:26.906197 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:04:26.906197 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:04:26.906197 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:04:26.906197 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:04:26.906197 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:04:26.906197 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 13:04:26.906197 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 13:04:26.906197 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 13:04:26.907527 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 13:04:26.907527 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 13:04:26.907527 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 13:04:26.907527 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 13:04:26.907527 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 13:04:26.907527 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 13:04:26.907527 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 13:04:26.907527 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 058a9566-8f0f-4920-b435-22ea5bee15e7 could not be found. Jul 05 13:04:26.907527 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:04:26.907527 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:04:26.907527 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:04:26.907527 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:04:26.907527 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:04:26.907527 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:04:26.907527 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 13:04:26.907527 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 13:04:26.907527 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 058a9566-8f0f-4920-b435-22ea5bee15e7 could not be found. Jul 05 13:04:26.907527 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:04:26.908897 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-6d3e4d08-ff0c-4213-a046-6dbddd36a2d0 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] Returning 404 to user: Instance 058a9566-8f0f-4920-b435-22ea5bee15e7 could not be found. {{(pid=118386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 13:04:26.908897 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-6d3e4d08-ff0c-4213-a046-6dbddd36a2d0 tempest-VolumesActionsTest-616891412 tempest-VolumesActionsTest-616891412-project] 10.222.0.36 "GET /compute/v2.1/servers/058a9566-8f0f-4920-b435-22ea5bee15e7" status: 404 len: 111 microversion: 2.1 time: 0.037487 Jul 05 13:04:26.908897 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 249/491] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:04:26 2022] GET /compute/v2.1/servers/058a9566-8f0f-4920-b435-22ea5bee15e7 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 13:04:26.979369 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-57328f4b-0813-4823-9300-6ccff3217070 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:26.992006 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-57328f4b-0813-4823-9300-6ccff3217070 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:27.001052 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-57328f4b-0813-4823-9300-6ccff3217070 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:27.001052 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-57328f4b-0813-4823-9300-6ccff3217070 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1809 microversion: 2.20 time: 0.205501 Jul 05 13:04:27.006346 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 243/492] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:04:26 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1809 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:04:27.455606 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [req-03b24070-66ef-4e34-bb58-8eac0ae40521 req-75c250a9-b5e4-4664-8fe3-ae9105fb9ba9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58708391-4350-4b7e-8616-f3f3534bd2e6", "tag": "dea25a3b-1daa-482f-9f40-46b326121051"}]} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:04:27.460525 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-03b24070-66ef-4e34-bb58-8eac0ae40521 req-75c250a9-b5e4-4664-8fe3-ae9105fb9ba9 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:27.461214 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-03b24070-66ef-4e34-bb58-8eac0ae40521 req-75c250a9-b5e4-4664-8fe3-ae9105fb9ba9 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:27.475049 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.compute.server_external_events [req-03b24070-66ef-4e34-bb58-8eac0ae40521 req-75c250a9-b5e4-4664-8fe3-ae9105fb9ba9 service nova] Creating event network-changed:dea25a3b-1daa-482f-9f40-46b326121051 for instance 58708391-4350-4b7e-8616-f3f3534bd2e6 on hv-cinder-79760 Jul 05 13:04:27.484167 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [req-03b24070-66ef-4e34-bb58-8eac0ae40521 req-75c250a9-b5e4-4664-8fe3-ae9105fb9ba9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035725 Jul 05 13:04:27.484167 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 250/493] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:04:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:04:28.013174 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-01a263fa-8fd7-4d3a-81f8-5150b0c2e3a8 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:28.013794 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-01a263fa-8fd7-4d3a-81f8-5150b0c2e3a8 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:28.022479 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-01a263fa-8fd7-4d3a-81f8-5150b0c2e3a8 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:28.023197 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-01a263fa-8fd7-4d3a-81f8-5150b0c2e3a8 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:28.024142 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-01a263fa-8fd7-4d3a-81f8-5150b0c2e3a8 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:28.024606 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-01a263fa-8fd7-4d3a-81f8-5150b0c2e3a8 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:28.204224 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-01a263fa-8fd7-4d3a-81f8-5150b0c2e3a8 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:28.222201 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-01a263fa-8fd7-4d3a-81f8-5150b0c2e3a8 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:28.223972 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-01a263fa-8fd7-4d3a-81f8-5150b0c2e3a8 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:28.225197 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-01a263fa-8fd7-4d3a-81f8-5150b0c2e3a8 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1809 microversion: 2.20 time: 0.216674 Jul 05 13:04:28.225756 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 244/494] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:04:28 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1809 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:04:29.244152 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-badf228a-16ff-4de3-89a3-d3f3c75ebd76 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:29.245293 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-badf228a-16ff-4de3-89a3-d3f3c75ebd76 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:29.252630 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-badf228a-16ff-4de3-89a3-d3f3c75ebd76 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:29.253359 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-badf228a-16ff-4de3-89a3-d3f3c75ebd76 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:29.254132 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-badf228a-16ff-4de3-89a3-d3f3c75ebd76 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:29.254562 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-badf228a-16ff-4de3-89a3-d3f3c75ebd76 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:29.399855 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-badf228a-16ff-4de3-89a3-d3f3c75ebd76 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:29.409027 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-badf228a-16ff-4de3-89a3-d3f3c75ebd76 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:29.410567 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-badf228a-16ff-4de3-89a3-d3f3c75ebd76 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:29.411711 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-badf228a-16ff-4de3-89a3-d3f3c75ebd76 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1809 microversion: 2.20 time: 0.172130 Jul 05 13:04:29.412261 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 251/495] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:04:29 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:04:30.432726 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-5f4cd235-41df-45ff-9d44-8e774f8ac3ce tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:30.433327 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-5f4cd235-41df-45ff-9d44-8e774f8ac3ce tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:30.439797 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5f4cd235-41df-45ff-9d44-8e774f8ac3ce tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:30.446424 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5f4cd235-41df-45ff-9d44-8e774f8ac3ce tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:30.446424 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5f4cd235-41df-45ff-9d44-8e774f8ac3ce tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:30.446424 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5f4cd235-41df-45ff-9d44-8e774f8ac3ce tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:30.572833 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-5f4cd235-41df-45ff-9d44-8e774f8ac3ce tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:30.581686 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-5f4cd235-41df-45ff-9d44-8e774f8ac3ce tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:30.583190 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-5f4cd235-41df-45ff-9d44-8e774f8ac3ce tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:30.584352 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-5f4cd235-41df-45ff-9d44-8e774f8ac3ce tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1809 microversion: 2.20 time: 0.155781 Jul 05 13:04:30.584934 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 245/496] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:04:30 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:04:31.602945 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-73989511-6be6-4216-9df3-42fbfe49ebcf tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:31.603479 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-73989511-6be6-4216-9df3-42fbfe49ebcf tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:31.605470 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_cell0:SELECT=4 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:04:31.606122 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=1 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:04:31.610778 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-73989511-6be6-4216-9df3-42fbfe49ebcf tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:31.611218 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-73989511-6be6-4216-9df3-42fbfe49ebcf tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:31.611962 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-73989511-6be6-4216-9df3-42fbfe49ebcf tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:31.612429 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-73989511-6be6-4216-9df3-42fbfe49ebcf tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:31.746936 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-73989511-6be6-4216-9df3-42fbfe49ebcf tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:31.755396 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-73989511-6be6-4216-9df3-42fbfe49ebcf tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:31.756915 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-73989511-6be6-4216-9df3-42fbfe49ebcf tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:31.758054 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-73989511-6be6-4216-9df3-42fbfe49ebcf tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1809 microversion: 2.20 time: 0.159290 Jul 05 13:04:31.758627 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 252/497] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:04:31 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:04:32.776227 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-9bcb06bb-7316-445e-b1f5-5adf5703ff19 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:32.777825 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-9bcb06bb-7316-445e-b1f5-5adf5703ff19 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:32.785437 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9bcb06bb-7316-445e-b1f5-5adf5703ff19 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:32.785893 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9bcb06bb-7316-445e-b1f5-5adf5703ff19 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:32.787528 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9bcb06bb-7316-445e-b1f5-5adf5703ff19 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:32.787528 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9bcb06bb-7316-445e-b1f5-5adf5703ff19 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:32.924231 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-9bcb06bb-7316-445e-b1f5-5adf5703ff19 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:32.934903 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-9bcb06bb-7316-445e-b1f5-5adf5703ff19 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:32.936418 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-9bcb06bb-7316-445e-b1f5-5adf5703ff19 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:32.937696 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-9bcb06bb-7316-445e-b1f5-5adf5703ff19 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1809 microversion: 2.20 time: 0.166462 Jul 05 13:04:32.938238 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 246/498] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:04:32 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:04:33.958261 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-906ca9d4-49fe-4666-ac74-6affb0c789e6 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:33.959670 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-906ca9d4-49fe-4666-ac74-6affb0c789e6 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:33.966088 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-906ca9d4-49fe-4666-ac74-6affb0c789e6 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:33.966557 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-906ca9d4-49fe-4666-ac74-6affb0c789e6 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:33.967351 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-906ca9d4-49fe-4666-ac74-6affb0c789e6 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:33.967805 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-906ca9d4-49fe-4666-ac74-6affb0c789e6 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:34.144264 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-906ca9d4-49fe-4666-ac74-6affb0c789e6 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:34.159729 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-906ca9d4-49fe-4666-ac74-6affb0c789e6 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:34.161546 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-906ca9d4-49fe-4666-ac74-6affb0c789e6 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:34.162904 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-906ca9d4-49fe-4666-ac74-6affb0c789e6 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1809 microversion: 2.20 time: 0.209247 Jul 05 13:04:34.163451 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 253/499] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:04:33 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1809 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 13:04:34.821908 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-b6314b32-2b4c-4e2e-8b5e-11e9d591ba96 req-bf9b6680-76b4-4abf-99a7-320100ef4276 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72285b0b-7735-422b-b110-ef7b03fb367f", "name": "network-vif-plugged", "status": "completed", "tag": "caf3b4b2-126a-423d-b8ca-4680670bb511"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:04:34.848434 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-b6314b32-2b4c-4e2e-8b5e-11e9d591ba96 req-bf9b6680-76b4-4abf-99a7-320100ef4276 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:34.849019 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-b6314b32-2b4c-4e2e-8b5e-11e9d591ba96 req-bf9b6680-76b4-4abf-99a7-320100ef4276 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:34.862080 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-b6314b32-2b4c-4e2e-8b5e-11e9d591ba96 req-bf9b6680-76b4-4abf-99a7-320100ef4276 service nova] Creating event network-vif-plugged:caf3b4b2-126a-423d-b8ca-4680670bb511 for instance 72285b0b-7735-422b-b110-ef7b03fb367f on hv-cinder-79760 Jul 05 13:04:34.867482 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-b6314b32-2b4c-4e2e-8b5e-11e9d591ba96 req-bf9b6680-76b4-4abf-99a7-320100ef4276 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049703 Jul 05 13:04:34.868086 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 247/500] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:04:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:04:35.181899 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-b87c4328-16b9-4e6d-8ca4-410c2a32e828 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:35.182472 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-b87c4328-16b9-4e6d-8ca4-410c2a32e828 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:35.188809 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b87c4328-16b9-4e6d-8ca4-410c2a32e828 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:35.189577 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b87c4328-16b9-4e6d-8ca4-410c2a32e828 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:35.190509 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b87c4328-16b9-4e6d-8ca4-410c2a32e828 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:35.191665 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b87c4328-16b9-4e6d-8ca4-410c2a32e828 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:35.390465 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-b87c4328-16b9-4e6d-8ca4-410c2a32e828 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:35.401330 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-b87c4328-16b9-4e6d-8ca4-410c2a32e828 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:35.404330 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-b87c4328-16b9-4e6d-8ca4-410c2a32e828 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:35.405948 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-b87c4328-16b9-4e6d-8ca4-410c2a32e828 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1809 microversion: 2.20 time: 0.227959 Jul 05 13:04:35.406529 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 254/501] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:04:35 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1809 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 13:04:36.426795 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-34071d54-0231-4f1b-9c13-f7adb34e1e26 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:36.427667 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-34071d54-0231-4f1b-9c13-f7adb34e1e26 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:36.442414 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-34071d54-0231-4f1b-9c13-f7adb34e1e26 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:36.443141 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-34071d54-0231-4f1b-9c13-f7adb34e1e26 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:36.445358 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-34071d54-0231-4f1b-9c13-f7adb34e1e26 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:36.446040 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-34071d54-0231-4f1b-9c13-f7adb34e1e26 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:36.590214 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-e7098d91-907f-4b03-b0bc-46ce05caeb1a tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:36.591670 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-e7098d91-907f-4b03-b0bc-46ce05caeb1a tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: fce1b2d5-4167-4f64-9ea2-794a86830bd2] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:36.597346 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-34071d54-0231-4f1b-9c13-f7adb34e1e26 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:36.610949 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-34071d54-0231-4f1b-9c13-f7adb34e1e26 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:36.611076 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e7098d91-907f-4b03-b0bc-46ce05caeb1a tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:36.611076 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e7098d91-907f-4b03-b0bc-46ce05caeb1a tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:36.611358 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-34071d54-0231-4f1b-9c13-f7adb34e1e26 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:36.612022 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e7098d91-907f-4b03-b0bc-46ce05caeb1a tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:36.613408 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e7098d91-907f-4b03-b0bc-46ce05caeb1a tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:36.613656 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-34071d54-0231-4f1b-9c13-f7adb34e1e26 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1809 microversion: 2.20 time: 0.191716 Jul 05 13:04:36.614516 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 248/502] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:04:36 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1809 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:04:36.634852 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_cell1:SELECT=100 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:04:36.644022 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-e7098d91-907f-4b03-b0bc-46ce05caeb1a tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2/ips" status: 200 len: 150 microversion: 2.1 time: 0.057659 Jul 05 13:04:36.649047 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 255/503] 10.222.0.36 () {58 vars in 1247 bytes} [Tue Jul 5 13:04:36 2022] GET /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2/ips => generated 150 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 13:04:36.660687 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-85dc1e71-ee0a-491b-87fb-f00b90a1c6af tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "40821f45-d5b7-4e86-a420-1a629ea60897"}} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:04:36.663479 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-85dc1e71-ee0a-491b-87fb-f00b90a1c6af tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: fce1b2d5-4167-4f64-9ea2-794a86830bd2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:36.670216 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-85dc1e71-ee0a-491b-87fb-f00b90a1c6af tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:36.670666 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-85dc1e71-ee0a-491b-87fb-f00b90a1c6af tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:36.671571 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-85dc1e71-ee0a-491b-87fb-f00b90a1c6af tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:36.672012 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-85dc1e71-ee0a-491b-87fb-f00b90a1c6af tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:36.763569 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.wsgi [None req-85dc1e71-ee0a-491b-87fb-f00b90a1c6af tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] HTTP exception thrown: Invalid volume: volume 40821f45-d5b7-4e86-a420-1a629ea60897 is already attached to instances: 0f8f2957-1273-413b-ab2b-32da8868f70d Jul 05 13:04:36.768296 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-85dc1e71-ee0a-491b-87fb-f00b90a1c6af tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Request method failure captured: Jul 05 13:04:36.768296 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: request: POST /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2/os-volume_attachments HTTP/1.1 Jul 05 13:04:36.768296 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept: application/json Jul 05 13:04:36.768296 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept-Encoding: identity Jul 05 13:04:36.768296 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Connection: close Jul 05 13:04:36.768296 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Length: 74 Jul 05 13:04:36.768296 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Type: application/json Jul 05 13:04:36.768296 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Host: 10.222.0.36 Jul 05 13:04:36.768296 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Openstack-System-Scope: None Jul 05 13:04:36.768296 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: User-Agent: python-urllib3/1.26.9 Jul 05 13:04:36.768296 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Auth-Token: gAAAAABixDYWQWL8uJCqum4c6BlnNfbR703HW4HnpwW8iX1I1pbqlc_QGnJWLD1G-z_DKnfPJbbyyKcDC4sR005HdVrBcj6np6lEImplVRPpD09FwDfrBAC23lqXzO2ZdNTX7uxeDP3sMtbJ8KEd2t_ks3LspqcGELiRwc6BksJqjl4JxwirzAA Jul 05 13:04:36.768296 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Id: None Jul 05 13:04:36.768296 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Name: None Jul 05 13:04:36.768296 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Identity-Status: Confirmed Jul 05 13:04:36.768296 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Is-Admin-Project: True Jul 05 13:04:36.768296 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Id: default Jul 05 13:04:36.768296 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Name: Default Jul 05 13:04:36.768296 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Id: 163f0d5f47be49f493296f228d1080a5 Jul 05 13:04:36.768296 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Name: tempest-AttachVolumeNegativeTest-1554059375 Jul 05 13:04:36.768296 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Role: member,reader Jul 05 13:04:36.768296 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Roles: member,reader Jul 05 13:04:36.769922 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/163f0d5f47be49f493296f228d1080a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_163f0d5f47be49f493296f228d1080a5", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/163f0d5f47be49f493296f228d1080a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/163f0d5f47be49f493296f228d1080a5"}]}] Jul 05 13:04:36.769922 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant: tempest-AttachVolumeNegativeTest-1554059375 Jul 05 13:04:36.769922 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Id: 163f0d5f47be49f493296f228d1080a5 Jul 05 13:04:36.769922 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1554059375 Jul 05 13:04:36.769922 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User: tempest-AttachVolumeNegativeTest-1554059375-project Jul 05 13:04:36.769922 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Id: default Jul 05 13:04:36.769922 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Name: Default Jul 05 13:04:36.769922 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Id: aa97e27060b3429bbad061a256db19f1 Jul 05 13:04:36.769922 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Name: tempest-AttachVolumeNegativeTest-1554059375-project Jul 05 13:04:36.769922 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Jul 05 13:04:36.769922 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: {"volumeAttachment": {"volumeId": "40821f45-d5b7-4e86-a420-1a629ea60897"}} Jul 05 13:04:36.769922 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: method: > Jul 05 13:04:36.770759 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: exception: Invalid volume: volume 40821f45-d5b7-4e86-a420-1a629ea60897 is already attached to instances: 0f8f2957-1273-413b-ab2b-32da8868f70d Jul 05 13:04:36.770759 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: action_args: {'server_id': 'fce1b2d5-4167-4f64-9ea2-794a86830bd2', 'body': {'volumeAttachment': {'volumeId': '40821f45-d5b7-4e86-a420-1a629ea60897'}}} Jul 05 13:04:36.770759 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 13:04:36.770759 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:04:36.770759 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 05 13:04:36.770759 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 05 13:04:36.770759 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 05 13:04:36.770759 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 05 13:04:36.770759 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 05 13:04:36.770759 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 05 13:04:36.770759 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 05 13:04:36.770759 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 05 13:04:36.770759 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 05 13:04:36.770759 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 05 13:04:36.770759 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 40821f45-d5b7-4e86-a420-1a629ea60897 is already attached to instances: 0f8f2957-1273-413b-ab2b-32da8868f70d Jul 05 13:04:36.770759 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:04:36.770759 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:04:36.770759 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:04:36.770759 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:04:36.772036 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:04:36.772036 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:04:36.772036 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 13:04:36.772036 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 13:04:36.772036 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 13:04:36.772036 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 13:04:36.772036 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 05 13:04:36.772036 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 05 13:04:36.772036 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 05 13:04:36.772036 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 05 13:04:36.772036 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 05 13:04:36.772036 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 05 13:04:36.772036 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 05 13:04:36.772036 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 05 13:04:36.772036 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 40821f45-d5b7-4e86-a420-1a629ea60897 is already attached to instances: 0f8f2957-1273-413b-ab2b-32da8868f70d Jul 05 13:04:36.772036 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:04:36.772036 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:04:36.772036 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:04:36.772036 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:04:36.772036 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:04:36.773258 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:04:36.773258 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 13:04:36.773258 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 13:04:36.773258 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 40821f45-d5b7-4e86-a420-1a629ea60897 is already attached to instances: 0f8f2957-1273-413b-ab2b-32da8868f70d Jul 05 13:04:36.773258 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:04:36.773258 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-85dc1e71-ee0a-491b-87fb-f00b90a1c6af tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Returning 400 to user: Invalid volume: volume 40821f45-d5b7-4e86-a420-1a629ea60897 is already attached to instances: 0f8f2957-1273-413b-ab2b-32da8868f70d {{(pid=118387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 13:04:36.773258 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-85dc1e71-ee0a-491b-87fb-f00b90a1c6af tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "POST /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.111546 Jul 05 13:04:36.773258 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 249/504] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Jul 5 13:04:36 2022] POST /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2/os-volume_attachments => generated 174 bytes in 113 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 05 13:04:36.776416 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-1b2da9e8-0119-4014-838e-5cc584d5744e tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:36.777185 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-1b2da9e8-0119-4014-838e-5cc584d5744e tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: fce1b2d5-4167-4f64-9ea2-794a86830bd2] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:36.784068 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-1b2da9e8-0119-4014-838e-5cc584d5744e tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:36.784534 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-1b2da9e8-0119-4014-838e-5cc584d5744e tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:36.785291 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-1b2da9e8-0119-4014-838e-5cc584d5744e tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:36.785721 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-1b2da9e8-0119-4014-838e-5cc584d5744e tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:36.813144 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-1b2da9e8-0119-4014-838e-5cc584d5744e tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: fce1b2d5-4167-4f64-9ea2-794a86830bd2] Going to try to terminate instance {{(pid=118386) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 13:04:37.151420 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-1b2da9e8-0119-4014-838e-5cc584d5744e tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "DELETE /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2" status: 204 len: 0 microversion: 2.1 time: 0.378509 Jul 05 13:04:37.152004 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 256/505] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jul 5 13:04:36 2022] DELETE /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 05 13:04:37.160866 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-5b174a70-c62a-4f40-aabb-c67793cb1b65 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:37.161484 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-5b174a70-c62a-4f40-aabb-c67793cb1b65 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: fce1b2d5-4167-4f64-9ea2-794a86830bd2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:37.170012 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5b174a70-c62a-4f40-aabb-c67793cb1b65 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:37.170471 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5b174a70-c62a-4f40-aabb-c67793cb1b65 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:37.171305 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5b174a70-c62a-4f40-aabb-c67793cb1b65 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:37.171746 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5b174a70-c62a-4f40-aabb-c67793cb1b65 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:37.320020 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-5b174a70-c62a-4f40-aabb-c67793cb1b65 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:37.333896 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-5b174a70-c62a-4f40-aabb-c67793cb1b65 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2" status: 200 len: 1682 microversion: 2.1 time: 0.176782 Jul 05 13:04:37.337883 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 250/506] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:04:37 2022] GET /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2 => generated 1682 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:04:37.632624 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-8196e602-ac54-4f98-a85f-764327e5639d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:37.633469 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-8196e602-ac54-4f98-a85f-764327e5639d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:37.640023 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-8196e602-ac54-4f98-a85f-764327e5639d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:37.640480 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-8196e602-ac54-4f98-a85f-764327e5639d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:37.641345 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-8196e602-ac54-4f98-a85f-764327e5639d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:37.641790 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-8196e602-ac54-4f98-a85f-764327e5639d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:37.809153 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-8196e602-ac54-4f98-a85f-764327e5639d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:37.816269 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-8196e602-ac54-4f98-a85f-764327e5639d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:37.817822 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-8196e602-ac54-4f98-a85f-764327e5639d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:37.819050 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-8196e602-ac54-4f98-a85f-764327e5639d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1809 microversion: 2.20 time: 0.191487 Jul 05 13:04:37.819911 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 257/507] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:04:37 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1809 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:04:38.357226 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-c0ad173e-39d6-4fbd-a128-04ea342d7b1b tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:38.358606 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-c0ad173e-39d6-4fbd-a128-04ea342d7b1b tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: fce1b2d5-4167-4f64-9ea2-794a86830bd2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:38.372993 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c0ad173e-39d6-4fbd-a128-04ea342d7b1b tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:38.373477 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c0ad173e-39d6-4fbd-a128-04ea342d7b1b tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:38.374268 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c0ad173e-39d6-4fbd-a128-04ea342d7b1b tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:38.374710 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c0ad173e-39d6-4fbd-a128-04ea342d7b1b tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:38.530356 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-c0ad173e-39d6-4fbd-a128-04ea342d7b1b tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:38.538890 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-c0ad173e-39d6-4fbd-a128-04ea342d7b1b tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2" status: 200 len: 1682 microversion: 2.1 time: 0.188480 Jul 05 13:04:38.539461 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 251/508] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:04:38 2022] GET /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2 => generated 1682 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:04:38.837679 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-15274804-f945-4052-a7eb-b68684e04cdb tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:38.838293 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-15274804-f945-4052-a7eb-b68684e04cdb tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:38.844395 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-15274804-f945-4052-a7eb-b68684e04cdb tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:38.844945 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-15274804-f945-4052-a7eb-b68684e04cdb tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:38.845699 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-15274804-f945-4052-a7eb-b68684e04cdb tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:38.846130 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-15274804-f945-4052-a7eb-b68684e04cdb tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:39.009972 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-15274804-f945-4052-a7eb-b68684e04cdb tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:39.020383 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-15274804-f945-4052-a7eb-b68684e04cdb tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:39.021937 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-15274804-f945-4052-a7eb-b68684e04cdb tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:39.023097 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-15274804-f945-4052-a7eb-b68684e04cdb tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1809 microversion: 2.20 time: 0.189332 Jul 05 13:04:39.024145 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 258/509] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:04:38 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1809 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:04:39.556068 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-d02a36a8-5389-451a-a329-c24afb3fb819 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:39.557453 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-d02a36a8-5389-451a-a329-c24afb3fb819 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: fce1b2d5-4167-4f64-9ea2-794a86830bd2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:39.567070 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d02a36a8-5389-451a-a329-c24afb3fb819 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:39.568229 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d02a36a8-5389-451a-a329-c24afb3fb819 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:39.572193 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d02a36a8-5389-451a-a329-c24afb3fb819 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:39.575817 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d02a36a8-5389-451a-a329-c24afb3fb819 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:39.755800 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-d02a36a8-5389-451a-a329-c24afb3fb819 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:39.764863 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-d02a36a8-5389-451a-a329-c24afb3fb819 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2" status: 200 len: 1682 microversion: 2.1 time: 0.212632 Jul 05 13:04:39.766286 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 252/510] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:04:39 2022] GET /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2 => generated 1682 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:04:40.045038 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-0320efe4-12e8-47a2-9299-eb6617ac99b8 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:40.046308 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-0320efe4-12e8-47a2-9299-eb6617ac99b8 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:40.055396 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-0320efe4-12e8-47a2-9299-eb6617ac99b8 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:40.056208 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-0320efe4-12e8-47a2-9299-eb6617ac99b8 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:40.057240 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-0320efe4-12e8-47a2-9299-eb6617ac99b8 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:40.057912 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-0320efe4-12e8-47a2-9299-eb6617ac99b8 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:40.269530 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-0320efe4-12e8-47a2-9299-eb6617ac99b8 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:40.283464 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-0320efe4-12e8-47a2-9299-eb6617ac99b8 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:40.291101 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-0320efe4-12e8-47a2-9299-eb6617ac99b8 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:40.292534 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-0320efe4-12e8-47a2-9299-eb6617ac99b8 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1809 microversion: 2.20 time: 0.253135 Jul 05 13:04:40.298485 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 259/511] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:04:40 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1809 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:04:40.783044 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-eee56e24-33c8-4b15-a4cb-c2652df0d26d tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:40.784957 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-eee56e24-33c8-4b15-a4cb-c2652df0d26d tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: fce1b2d5-4167-4f64-9ea2-794a86830bd2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:40.798559 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-eee56e24-33c8-4b15-a4cb-c2652df0d26d tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:40.799258 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-eee56e24-33c8-4b15-a4cb-c2652df0d26d tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:40.800859 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-eee56e24-33c8-4b15-a4cb-c2652df0d26d tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:40.802034 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-eee56e24-33c8-4b15-a4cb-c2652df0d26d tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:40.868364 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [req-a56695a0-6e18-4245-adf9-7eedb5c647cb req-98a58697-5d33-4053-a368-3442ff7b6ca1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fce1b2d5-4167-4f64-9ea2-794a86830bd2", "name": "network-vif-deleted", "tag": "8a5a6e9b-a8fd-4e32-a9e6-6141c6a65210"}]} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:04:40.884746 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-a56695a0-6e18-4245-adf9-7eedb5c647cb req-98a58697-5d33-4053-a368-3442ff7b6ca1 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:40.885574 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-a56695a0-6e18-4245-adf9-7eedb5c647cb req-98a58697-5d33-4053-a368-3442ff7b6ca1 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:40.906362 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-eee56e24-33c8-4b15-a4cb-c2652df0d26d tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:40.913671 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.compute.server_external_events [req-a56695a0-6e18-4245-adf9-7eedb5c647cb req-98a58697-5d33-4053-a368-3442ff7b6ca1 service nova] Creating event network-vif-deleted:8a5a6e9b-a8fd-4e32-a9e6-6141c6a65210 for instance fce1b2d5-4167-4f64-9ea2-794a86830bd2 on hv-cinder-79760 Jul 05 13:04:40.918395 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-eee56e24-33c8-4b15-a4cb-c2652df0d26d tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2" status: 200 len: 1614 microversion: 2.1 time: 0.139351 Jul 05 13:04:40.919977 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 253/512] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:04:40 2022] GET /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2 => generated 1614 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:04:40.930192 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [req-a56695a0-6e18-4245-adf9-7eedb5c647cb req-98a58697-5d33-4053-a368-3442ff7b6ca1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065205 Jul 05 13:04:40.937088 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 260/513] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:04:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 13:04:41.320912 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-adef7fa2-8779-4900-a9d8-b2714f1939d4 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:41.321993 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-adef7fa2-8779-4900-a9d8-b2714f1939d4 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:41.336823 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-adef7fa2-8779-4900-a9d8-b2714f1939d4 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:41.337697 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-adef7fa2-8779-4900-a9d8-b2714f1939d4 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:41.338753 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-adef7fa2-8779-4900-a9d8-b2714f1939d4 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:41.339286 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-adef7fa2-8779-4900-a9d8-b2714f1939d4 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:41.562359 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-adef7fa2-8779-4900-a9d8-b2714f1939d4 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:41.575016 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-adef7fa2-8779-4900-a9d8-b2714f1939d4 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:41.590130 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-adef7fa2-8779-4900-a9d8-b2714f1939d4 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:41.593370 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-adef7fa2-8779-4900-a9d8-b2714f1939d4 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1809 microversion: 2.20 time: 0.279822 Jul 05 13:04:41.595870 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 254/514] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:04:41 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1809 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:04:41.944862 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-a7259d2c-c177-4653-b258-dc2a89489ec6 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:41.946186 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-a7259d2c-c177-4653-b258-dc2a89489ec6 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: fce1b2d5-4167-4f64-9ea2-794a86830bd2] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:41.978093 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a7259d2c-c177-4653-b258-dc2a89489ec6 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:41.981471 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a7259d2c-c177-4653-b258-dc2a89489ec6 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:41.982505 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a7259d2c-c177-4653-b258-dc2a89489ec6 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:41.984771 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a7259d2c-c177-4653-b258-dc2a89489ec6 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:42.054803 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a7259d2c-c177-4653-b258-dc2a89489ec6 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:42.055838 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a7259d2c-c177-4653-b258-dc2a89489ec6 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:42.058028 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.objects.instance [None req-a7259d2c-c177-4653-b258-dc2a89489ec6 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lazy-loading 'fault' on Instance uuid fce1b2d5-4167-4f64-9ea2-794a86830bd2 {{(pid=118386) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 13:04:42.174986 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-a7259d2c-c177-4653-b258-dc2a89489ec6 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:42.188330 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-a7259d2c-c177-4653-b258-dc2a89489ec6 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2" status: 200 len: 1331 microversion: 2.1 time: 0.255126 Jul 05 13:04:42.193930 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 261/515] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:04:41 2022] GET /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2 => generated 1331 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:04:42.619858 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-f2686b17-3f68-4dbc-8240-94453d09a536 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:42.634344 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-f2686b17-3f68-4dbc-8240-94453d09a536 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:42.646020 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f2686b17-3f68-4dbc-8240-94453d09a536 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:42.646759 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f2686b17-3f68-4dbc-8240-94453d09a536 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:42.647836 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f2686b17-3f68-4dbc-8240-94453d09a536 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:42.648506 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f2686b17-3f68-4dbc-8240-94453d09a536 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:42.907492 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-f2686b17-3f68-4dbc-8240-94453d09a536 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:42.920975 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-f2686b17-3f68-4dbc-8240-94453d09a536 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:42.924344 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-f2686b17-3f68-4dbc-8240-94453d09a536 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:42.925437 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-f2686b17-3f68-4dbc-8240-94453d09a536 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1809 microversion: 2.20 time: 0.309649 Jul 05 13:04:42.926291 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 255/516] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:04:42 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1809 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:04:43.214327 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-fe91b441-80e3-4046-b799-f25e828ef15a tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:43.216817 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-fe91b441-80e3-4046-b799-f25e828ef15a tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: fce1b2d5-4167-4f64-9ea2-794a86830bd2] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:43.227256 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-fe91b441-80e3-4046-b799-f25e828ef15a tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:43.228221 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-fe91b441-80e3-4046-b799-f25e828ef15a tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:43.229884 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-fe91b441-80e3-4046-b799-f25e828ef15a tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:43.232623 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-fe91b441-80e3-4046-b799-f25e828ef15a tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:43.274732 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.wsgi [None req-fe91b441-80e3-4046-b799-f25e828ef15a tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] HTTP exception thrown: Instance fce1b2d5-4167-4f64-9ea2-794a86830bd2 could not be found. Jul 05 13:04:43.288875 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-fe91b441-80e3-4046-b799-f25e828ef15a tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Request method failure captured: Jul 05 13:04:43.288875 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: request: GET /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2 HTTP/1.1 Jul 05 13:04:43.288875 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Accept: application/json Jul 05 13:04:43.288875 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Accept-Encoding: identity Jul 05 13:04:43.288875 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Connection: close Jul 05 13:04:43.288875 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Content-Length: 0 Jul 05 13:04:43.288875 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Content-Type: application/json Jul 05 13:04:43.288875 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Host: 10.222.0.36 Jul 05 13:04:43.288875 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Openstack-System-Scope: None Jul 05 13:04:43.288875 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: User-Agent: python-urllib3/1.26.9 Jul 05 13:04:43.288875 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Auth-Token: gAAAAABixDYWQWL8uJCqum4c6BlnNfbR703HW4HnpwW8iX1I1pbqlc_QGnJWLD1G-z_DKnfPJbbyyKcDC4sR005HdVrBcj6np6lEImplVRPpD09FwDfrBAC23lqXzO2ZdNTX7uxeDP3sMtbJ8KEd2t_ks3LspqcGELiRwc6BksJqjl4JxwirzAA Jul 05 13:04:43.288875 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Domain-Id: None Jul 05 13:04:43.288875 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Domain-Name: None Jul 05 13:04:43.288875 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Identity-Status: Confirmed Jul 05 13:04:43.288875 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Is-Admin-Project: True Jul 05 13:04:43.288875 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Domain-Id: default Jul 05 13:04:43.288875 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Domain-Name: Default Jul 05 13:04:43.288875 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Id: 163f0d5f47be49f493296f228d1080a5 Jul 05 13:04:43.288875 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Name: tempest-AttachVolumeNegativeTest-1554059375 Jul 05 13:04:43.288875 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Role: member,reader Jul 05 13:04:43.288875 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Roles: member,reader Jul 05 13:04:43.290733 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/163f0d5f47be49f493296f228d1080a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_163f0d5f47be49f493296f228d1080a5", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/163f0d5f47be49f493296f228d1080a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/163f0d5f47be49f493296f228d1080a5"}]}] Jul 05 13:04:43.290733 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Tenant: tempest-AttachVolumeNegativeTest-1554059375 Jul 05 13:04:43.290733 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Tenant-Id: 163f0d5f47be49f493296f228d1080a5 Jul 05 13:04:43.290733 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1554059375 Jul 05 13:04:43.290733 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User: tempest-AttachVolumeNegativeTest-1554059375-project Jul 05 13:04:43.290733 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Domain-Id: default Jul 05 13:04:43.290733 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Domain-Name: Default Jul 05 13:04:43.290733 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Id: aa97e27060b3429bbad061a256db19f1 Jul 05 13:04:43.290733 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Name: tempest-AttachVolumeNegativeTest-1554059375-project Jul 05 13:04:43.290733 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: method: > Jul 05 13:04:43.290733 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: exception: Instance fce1b2d5-4167-4f64-9ea2-794a86830bd2 could not be found. Jul 05 13:04:43.290733 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: action_args: {'id': 'fce1b2d5-4167-4f64-9ea2-794a86830bd2'} Jul 05 13:04:43.291713 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 13:04:43.291713 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:04:43.291713 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 13:04:43.291713 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 13:04:43.291713 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 13:04:43.291713 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 13:04:43.291713 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 13:04:43.291713 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 13:04:43.291713 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 13:04:43.291713 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 13:04:43.291713 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fce1b2d5-4167-4f64-9ea2-794a86830bd2 could not be found. Jul 05 13:04:43.291713 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:04:43.291713 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:04:43.291713 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:04:43.291713 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:04:43.291713 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:04:43.291713 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:04:43.291713 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 13:04:43.291713 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 13:04:43.291713 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 13:04:43.294901 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 13:04:43.294901 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 13:04:43.294901 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 13:04:43.294901 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 13:04:43.294901 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 13:04:43.294901 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 13:04:43.294901 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 13:04:43.294901 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fce1b2d5-4167-4f64-9ea2-794a86830bd2 could not be found. Jul 05 13:04:43.294901 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:04:43.294901 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:04:43.294901 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:04:43.294901 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:04:43.294901 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:04:43.294901 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:04:43.294901 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 13:04:43.294901 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 13:04:43.294901 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fce1b2d5-4167-4f64-9ea2-794a86830bd2 could not be found. Jul 05 13:04:43.294901 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:04:43.297673 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-fe91b441-80e3-4046-b799-f25e828ef15a tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Returning 404 to user: Instance fce1b2d5-4167-4f64-9ea2-794a86830bd2 could not be found. {{(pid=118386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 13:04:43.297673 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-fe91b441-80e3-4046-b799-f25e828ef15a tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2" status: 404 len: 111 microversion: 2.1 time: 0.086007 Jul 05 13:04:43.297673 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 262/517] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:04:43 2022] GET /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 13:04:43.304517 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-3fdad700-fdfa-43cc-a5d3-48b64c075de3 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '.version_select at 0x7f70de6fee50>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:43.392860 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-3fdad700-fdfa-43cc-a5d3-48b64c075de3 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1087570709" status: 202 len: 0 microversion: 2.1 time: 0.092237 Jul 05 13:04:43.394195 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 256/518] 10.222.0.36 () {58 vars in 1220 bytes} [Tue Jul 5 13:04:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1087570709 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 13:04:43.944787 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-80c2ad32-d12d-4db4-8bfd-3ef874a1e1e1 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:43.945511 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-80c2ad32-d12d-4db4-8bfd-3ef874a1e1e1 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:43.960225 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-80c2ad32-d12d-4db4-8bfd-3ef874a1e1e1 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:43.962195 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-80c2ad32-d12d-4db4-8bfd-3ef874a1e1e1 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:43.963050 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-80c2ad32-d12d-4db4-8bfd-3ef874a1e1e1 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:43.963493 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-80c2ad32-d12d-4db4-8bfd-3ef874a1e1e1 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:44.151002 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-80c2ad32-d12d-4db4-8bfd-3ef874a1e1e1 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:44.160541 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-80c2ad32-d12d-4db4-8bfd-3ef874a1e1e1 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:44.162100 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-80c2ad32-d12d-4db4-8bfd-3ef874a1e1e1 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:44.163282 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-80c2ad32-d12d-4db4-8bfd-3ef874a1e1e1 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1809 microversion: 2.20 time: 0.223680 Jul 05 13:04:44.163849 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 263/519] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:04:43 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1809 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:04:44.452020 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-7cec419e-c31c-4900-a46d-56b5962234ef tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:44.453210 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-7cec419e-c31c-4900-a46d-56b5962234ef tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 0f8f2957-1273-413b-ab2b-32da8868f70d] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:44.460534 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7cec419e-c31c-4900-a46d-56b5962234ef tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:44.461009 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7cec419e-c31c-4900-a46d-56b5962234ef tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:44.462025 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7cec419e-c31c-4900-a46d-56b5962234ef tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:44.462738 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7cec419e-c31c-4900-a46d-56b5962234ef tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:44.548939 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell1:SELECT=100 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:04:44.629613 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.objects.instance [None req-7cec419e-c31c-4900-a46d-56b5962234ef tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lazy-loading 'services' on Instance uuid 0f8f2957-1273-413b-ab2b-32da8868f70d {{(pid=118387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 13:04:44.918286 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-7cec419e-c31c-4900-a46d-56b5962234ef tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "DELETE /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d/os-volume_attachments/40821f45-d5b7-4e86-a420-1a629ea60897" status: 202 len: 0 microversion: 2.1 time: 0.470855 Jul 05 13:04:44.919200 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 257/520] 10.222.0.36 () {58 vars in 1415 bytes} [Tue Jul 5 13:04:44 2022] DELETE /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d/os-volume_attachments/40821f45-d5b7-4e86-a420-1a629ea60897 => generated 0 bytes in 473 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 13:04:44.927549 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-56abe5aa-dc73-4435-8c69-02c0b1172687 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:44.929124 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-56abe5aa-dc73-4435-8c69-02c0b1172687 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 0f8f2957-1273-413b-ab2b-32da8868f70d] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:44.937905 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-56abe5aa-dc73-4435-8c69-02c0b1172687 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:44.938386 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-56abe5aa-dc73-4435-8c69-02c0b1172687 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:44.939073 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-56abe5aa-dc73-4435-8c69-02c0b1172687 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:44.939501 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-56abe5aa-dc73-4435-8c69-02c0b1172687 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:44.973462 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-56abe5aa-dc73-4435-8c69-02c0b1172687 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050024 Jul 05 13:04:44.974016 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 264/521] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jul 5 13:04:44 2022] GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 13:04:45.182427 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-0d4ae876-76c8-446d-974d-a1666bf6a7c9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:45.183307 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-0d4ae876-76c8-446d-974d-a1666bf6a7c9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:45.190837 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0d4ae876-76c8-446d-974d-a1666bf6a7c9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:45.191304 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0d4ae876-76c8-446d-974d-a1666bf6a7c9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:45.192090 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0d4ae876-76c8-446d-974d-a1666bf6a7c9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:45.192537 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0d4ae876-76c8-446d-974d-a1666bf6a7c9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:45.357536 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-0d4ae876-76c8-446d-974d-a1666bf6a7c9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:45.368908 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-0d4ae876-76c8-446d-974d-a1666bf6a7c9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:45.370461 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-0d4ae876-76c8-446d-974d-a1666bf6a7c9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:45.372191 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-0d4ae876-76c8-446d-974d-a1666bf6a7c9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1809 microversion: 2.20 time: 0.194536 Jul 05 13:04:45.383989 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 258/522] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:04:45 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1809 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:04:45.990656 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-0c20faa5-648e-471c-ae57-ee1421229d19 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:45.992800 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-0c20faa5-648e-471c-ae57-ee1421229d19 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 0f8f2957-1273-413b-ab2b-32da8868f70d] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:45.999545 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-0c20faa5-648e-471c-ae57-ee1421229d19 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:46.000002 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-0c20faa5-648e-471c-ae57-ee1421229d19 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:46.000978 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-0c20faa5-648e-471c-ae57-ee1421229d19 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:46.001546 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-0c20faa5-648e-471c-ae57-ee1421229d19 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:46.034818 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-0c20faa5-648e-471c-ae57-ee1421229d19 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049574 Jul 05 13:04:46.035936 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 265/523] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jul 5 13:04:45 2022] GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:04:46.391387 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-ef8170c8-dcc1-4274-a37a-763cbd1d36fd tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:46.392328 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-ef8170c8-dcc1-4274-a37a-763cbd1d36fd tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:46.399550 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ef8170c8-dcc1-4274-a37a-763cbd1d36fd tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:46.399904 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ef8170c8-dcc1-4274-a37a-763cbd1d36fd tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:46.401033 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ef8170c8-dcc1-4274-a37a-763cbd1d36fd tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:46.401614 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ef8170c8-dcc1-4274-a37a-763cbd1d36fd tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:46.577067 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-ef8170c8-dcc1-4274-a37a-763cbd1d36fd tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:46.593179 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-ef8170c8-dcc1-4274-a37a-763cbd1d36fd tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:46.593179 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-ef8170c8-dcc1-4274-a37a-763cbd1d36fd tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:46.593179 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-ef8170c8-dcc1-4274-a37a-763cbd1d36fd tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1809 microversion: 2.20 time: 0.205152 Jul 05 13:04:46.593805 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 259/524] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:04:46 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1809 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:04:47.051530 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-366e4d0e-b4fa-4507-8739-33e3cea0142c tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:47.053179 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-366e4d0e-b4fa-4507-8739-33e3cea0142c tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 0f8f2957-1273-413b-ab2b-32da8868f70d] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:47.060910 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-366e4d0e-b4fa-4507-8739-33e3cea0142c tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:47.061676 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-366e4d0e-b4fa-4507-8739-33e3cea0142c tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:47.062698 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-366e4d0e-b4fa-4507-8739-33e3cea0142c tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:47.063350 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-366e4d0e-b4fa-4507-8739-33e3cea0142c tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:47.129069 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-366e4d0e-b4fa-4507-8739-33e3cea0142c tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.082789 Jul 05 13:04:47.130792 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 266/525] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jul 5 13:04:47 2022] GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d/os-volume_attachments => generated 25 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 05 13:04:47.199759 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-a1aaa1f0-c2c8-49d3-a5b0-20331475922b tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:47.201087 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-a1aaa1f0-c2c8-49d3-a5b0-20331475922b tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 0f8f2957-1273-413b-ab2b-32da8868f70d] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:47.210519 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a1aaa1f0-c2c8-49d3-a5b0-20331475922b tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:47.211304 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a1aaa1f0-c2c8-49d3-a5b0-20331475922b tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:47.212323 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a1aaa1f0-c2c8-49d3-a5b0-20331475922b tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:47.213005 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a1aaa1f0-c2c8-49d3-a5b0-20331475922b tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:47.272999 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-a1aaa1f0-c2c8-49d3-a5b0-20331475922b tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 0f8f2957-1273-413b-ab2b-32da8868f70d] Going to try to terminate instance {{(pid=118387) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 13:04:47.611443 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-30ec3c35-b77b-4ab4-b25c-61b6c5c8ad2c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:47.612077 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-30ec3c35-b77b-4ab4-b25c-61b6c5c8ad2c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:47.618130 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-30ec3c35-b77b-4ab4-b25c-61b6c5c8ad2c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:47.618585 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-30ec3c35-b77b-4ab4-b25c-61b6c5c8ad2c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:47.619340 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-30ec3c35-b77b-4ab4-b25c-61b6c5c8ad2c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:47.619807 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-30ec3c35-b77b-4ab4-b25c-61b6c5c8ad2c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:47.693973 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-a1aaa1f0-c2c8-49d3-a5b0-20331475922b tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "DELETE /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d" status: 204 len: 0 microversion: 2.1 time: 0.498797 Jul 05 13:04:47.694577 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 260/526] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jul 5 13:04:47 2022] DELETE /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d => generated 0 bytes in 500 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 05 13:04:47.704389 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-ea4a892d-3fb7-40bf-92d5-e14a23535295 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:47.705233 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-ea4a892d-3fb7-40bf-92d5-e14a23535295 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 0f8f2957-1273-413b-ab2b-32da8868f70d] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:47.721582 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ea4a892d-3fb7-40bf-92d5-e14a23535295 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:47.722699 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ea4a892d-3fb7-40bf-92d5-e14a23535295 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:47.723806 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ea4a892d-3fb7-40bf-92d5-e14a23535295 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:47.725374 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ea4a892d-3fb7-40bf-92d5-e14a23535295 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:47.764349 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-30ec3c35-b77b-4ab4-b25c-61b6c5c8ad2c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:47.774815 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-30ec3c35-b77b-4ab4-b25c-61b6c5c8ad2c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:47.776698 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-30ec3c35-b77b-4ab4-b25c-61b6c5c8ad2c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:47.778241 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-30ec3c35-b77b-4ab4-b25c-61b6c5c8ad2c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1796 microversion: 2.20 time: 0.170511 Jul 05 13:04:47.790990 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 267/527] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:04:47 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1796 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:04:47.928172 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-ea4a892d-3fb7-40bf-92d5-e14a23535295 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:47.936127 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-ea4a892d-3fb7-40bf-92d5-e14a23535295 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d" status: 200 len: 1682 microversion: 2.1 time: 0.236964 Jul 05 13:04:47.937327 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 261/528] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:04:47 2022] GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d => generated 1682 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:04:48.954597 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-4d42bc31-1a84-4550-ac52-cd8487178547 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:48.955216 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-4d42bc31-1a84-4550-ac52-cd8487178547 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 0f8f2957-1273-413b-ab2b-32da8868f70d] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:48.966538 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-4d42bc31-1a84-4550-ac52-cd8487178547 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:48.967290 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-4d42bc31-1a84-4550-ac52-cd8487178547 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:48.968322 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-4d42bc31-1a84-4550-ac52-cd8487178547 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:48.968868 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-4d42bc31-1a84-4550-ac52-cd8487178547 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:49.213815 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-4d42bc31-1a84-4550-ac52-cd8487178547 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:49.225403 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-4d42bc31-1a84-4550-ac52-cd8487178547 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d" status: 200 len: 1682 microversion: 2.1 time: 0.274818 Jul 05 13:04:49.226332 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 268/529] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:04:48 2022] GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d => generated 1682 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:04:50.248296 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-f12ce971-4600-4426-b38e-f22be641f98e tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:50.248296 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-f12ce971-4600-4426-b38e-f22be641f98e tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 0f8f2957-1273-413b-ab2b-32da8868f70d] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:50.248296 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_api:SELECT=66,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:04:50.257235 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f12ce971-4600-4426-b38e-f22be641f98e tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:50.257696 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f12ce971-4600-4426-b38e-f22be641f98e tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:50.259659 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f12ce971-4600-4426-b38e-f22be641f98e tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:50.260112 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f12ce971-4600-4426-b38e-f22be641f98e tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:50.489559 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-f12ce971-4600-4426-b38e-f22be641f98e tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:50.508129 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-f12ce971-4600-4426-b38e-f22be641f98e tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d" status: 200 len: 1682 microversion: 2.1 time: 0.268620 Jul 05 13:04:50.511920 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 262/530] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:04:50 2022] GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d => generated 1682 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:04:51.401246 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [req-d5fed307-3f55-40b8-9df5-449bc23401eb req-a61f3235-4820-4c87-b48c-bf90184abedd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f8f2957-1273-413b-ab2b-32da8868f70d", "name": "network-vif-deleted", "tag": "ce361f6b-ae21-4c14-aee3-5bdf13b4b44f"}]} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:04:51.410832 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-d5fed307-3f55-40b8-9df5-449bc23401eb req-a61f3235-4820-4c87-b48c-bf90184abedd service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:51.411266 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-d5fed307-3f55-40b8-9df5-449bc23401eb req-a61f3235-4820-4c87-b48c-bf90184abedd service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:51.422167 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.compute.server_external_events [req-d5fed307-3f55-40b8-9df5-449bc23401eb req-a61f3235-4820-4c87-b48c-bf90184abedd service nova] Creating event network-vif-deleted:ce361f6b-ae21-4c14-aee3-5bdf13b4b44f for instance 0f8f2957-1273-413b-ab2b-32da8868f70d on hv-cinder-79760 Jul 05 13:04:51.432611 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [req-d5fed307-3f55-40b8-9df5-449bc23401eb req-a61f3235-4820-4c87-b48c-bf90184abedd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031654 Jul 05 13:04:51.432611 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 269/531] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:04:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:04:51.531980 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-6ae8ea03-92eb-45ee-a7b6-531006832942 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:51.533674 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-6ae8ea03-92eb-45ee-a7b6-531006832942 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 0f8f2957-1273-413b-ab2b-32da8868f70d] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:51.555401 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6ae8ea03-92eb-45ee-a7b6-531006832942 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:51.556055 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6ae8ea03-92eb-45ee-a7b6-531006832942 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:51.557525 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6ae8ea03-92eb-45ee-a7b6-531006832942 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:51.558138 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6ae8ea03-92eb-45ee-a7b6-531006832942 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:51.682393 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-6ae8ea03-92eb-45ee-a7b6-531006832942 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:51.690848 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-6ae8ea03-92eb-45ee-a7b6-531006832942 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d" status: 200 len: 1327 microversion: 2.1 time: 0.162726 Jul 05 13:04:51.691446 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 263/532] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:04:51 2022] GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d => generated 1327 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:04:52.709493 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-47b90b9b-07dc-49df-a552-9c364d72ead7 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:52.710256 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-47b90b9b-07dc-49df-a552-9c364d72ead7 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 0f8f2957-1273-413b-ab2b-32da8868f70d] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:52.726483 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-47b90b9b-07dc-49df-a552-9c364d72ead7 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:52.727361 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-47b90b9b-07dc-49df-a552-9c364d72ead7 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:52.729718 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-47b90b9b-07dc-49df-a552-9c364d72ead7 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:52.734619 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-47b90b9b-07dc-49df-a552-9c364d72ead7 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:52.752115 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.wsgi [None req-47b90b9b-07dc-49df-a552-9c364d72ead7 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] HTTP exception thrown: Instance 0f8f2957-1273-413b-ab2b-32da8868f70d could not be found. Jul 05 13:04:52.757461 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-47b90b9b-07dc-49df-a552-9c364d72ead7 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Request method failure captured: Jul 05 13:04:52.757461 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: request: GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d HTTP/1.1 Jul 05 13:04:52.757461 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Accept: application/json Jul 05 13:04:52.757461 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Accept-Encoding: identity Jul 05 13:04:52.757461 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Connection: close Jul 05 13:04:52.757461 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Content-Length: 0 Jul 05 13:04:52.757461 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Content-Type: application/json Jul 05 13:04:52.757461 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Host: 10.222.0.36 Jul 05 13:04:52.757461 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Openstack-System-Scope: None Jul 05 13:04:52.757461 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: User-Agent: python-urllib3/1.26.9 Jul 05 13:04:52.757461 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Auth-Token: gAAAAABixDYWQWL8uJCqum4c6BlnNfbR703HW4HnpwW8iX1I1pbqlc_QGnJWLD1G-z_DKnfPJbbyyKcDC4sR005HdVrBcj6np6lEImplVRPpD09FwDfrBAC23lqXzO2ZdNTX7uxeDP3sMtbJ8KEd2t_ks3LspqcGELiRwc6BksJqjl4JxwirzAA Jul 05 13:04:52.757461 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Domain-Id: None Jul 05 13:04:52.757461 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Domain-Name: None Jul 05 13:04:52.757461 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Identity-Status: Confirmed Jul 05 13:04:52.757461 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Is-Admin-Project: True Jul 05 13:04:52.757461 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Domain-Id: default Jul 05 13:04:52.757461 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Domain-Name: Default Jul 05 13:04:52.757461 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Id: 163f0d5f47be49f493296f228d1080a5 Jul 05 13:04:52.757461 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Name: tempest-AttachVolumeNegativeTest-1554059375 Jul 05 13:04:52.757461 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Role: member,reader Jul 05 13:04:52.757461 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Roles: member,reader Jul 05 13:04:52.759050 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/163f0d5f47be49f493296f228d1080a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_163f0d5f47be49f493296f228d1080a5", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/163f0d5f47be49f493296f228d1080a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/163f0d5f47be49f493296f228d1080a5"}]}] Jul 05 13:04:52.759050 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Tenant: tempest-AttachVolumeNegativeTest-1554059375 Jul 05 13:04:52.759050 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Tenant-Id: 163f0d5f47be49f493296f228d1080a5 Jul 05 13:04:52.759050 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1554059375 Jul 05 13:04:52.759050 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User: tempest-AttachVolumeNegativeTest-1554059375-project Jul 05 13:04:52.759050 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Domain-Id: default Jul 05 13:04:52.759050 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Domain-Name: Default Jul 05 13:04:52.759050 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Id: aa97e27060b3429bbad061a256db19f1 Jul 05 13:04:52.759050 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Name: tempest-AttachVolumeNegativeTest-1554059375-project Jul 05 13:04:52.759050 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: method: > Jul 05 13:04:52.759050 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: exception: Instance 0f8f2957-1273-413b-ab2b-32da8868f70d could not be found. Jul 05 13:04:52.759050 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: action_args: {'id': '0f8f2957-1273-413b-ab2b-32da8868f70d'} Jul 05 13:04:52.759916 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 13:04:52.759916 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:04:52.759916 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 13:04:52.759916 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 13:04:52.759916 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 13:04:52.759916 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 13:04:52.759916 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 13:04:52.759916 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 13:04:52.759916 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 13:04:52.759916 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 13:04:52.759916 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f8f2957-1273-413b-ab2b-32da8868f70d could not be found. Jul 05 13:04:52.759916 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:04:52.759916 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:04:52.759916 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:04:52.759916 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:04:52.759916 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:04:52.759916 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:04:52.759916 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 13:04:52.759916 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 13:04:52.759916 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 13:04:52.761361 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 13:04:52.761361 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 13:04:52.761361 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 13:04:52.761361 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 13:04:52.761361 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 13:04:52.761361 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 13:04:52.761361 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 13:04:52.761361 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f8f2957-1273-413b-ab2b-32da8868f70d could not be found. Jul 05 13:04:52.761361 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:04:52.761361 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:04:52.761361 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:04:52.761361 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:04:52.761361 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:04:52.761361 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:04:52.761361 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 13:04:52.761361 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 13:04:52.761361 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f8f2957-1273-413b-ab2b-32da8868f70d could not be found. Jul 05 13:04:52.761361 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:04:52.764366 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-47b90b9b-07dc-49df-a552-9c364d72ead7 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Returning 404 to user: Instance 0f8f2957-1273-413b-ab2b-32da8868f70d could not be found. {{(pid=118386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 13:04:52.765759 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-47b90b9b-07dc-49df-a552-9c364d72ead7 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d" status: 404 len: 111 microversion: 2.1 time: 0.061121 Jul 05 13:04:52.766665 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 270/533] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:04:52 2022] GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 13:04:52.775127 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-1d6190af-7aee-4ec8-a3fb-bfd723ea6e6a tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '.version_select at 0x7f70de6d7dc0>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:52.878461 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-1d6190af-7aee-4ec8-a3fb-bfd723ea6e6a tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1376741962" status: 202 len: 0 microversion: 2.1 time: 0.106973 Jul 05 13:04:52.879394 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 264/534] 10.222.0.36 () {58 vars in 1220 bytes} [Tue Jul 5 13:04:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1376741962 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 13:04:53.233013 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-15bd74da-4a1a-4b5e-956c-62ef606bb921 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1919368968", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1066638790", "security_groups": [{"name": "tempest-secgroup-smoke-350473549"}], "block_device_mapping_v2": [{"uuid": "46f24030-b09b-4e9c-b525-ece80dcc0197", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6d0ec387-dad6-4122-8b47-8b2426ab2be9"}]}} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:04:53.426555 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.network.neutron [None req-15bd74da-4a1a-4b5e-956c-62ef606bb921 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] validate_networks() for [('6d0ec387-dad6-4122-8b47-8b2426ab2be9', None, None, None, None, None)] {{(pid=118386) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 13:04:53.943523 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.virt.hardware [None req-15bd74da-4a1a-4b5e-956c-62ef606bb921 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Flavor limits 0:0:0 {{(pid=118386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 13:04:53.944096 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.virt.hardware [None req-15bd74da-4a1a-4b5e-956c-62ef606bb921 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Image limits 0:0:0 {{(pid=118386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 13:04:53.944414 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.virt.hardware [None req-15bd74da-4a1a-4b5e-956c-62ef606bb921 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Flavor pref 0:0:0 {{(pid=118386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 13:04:53.944863 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.virt.hardware [None req-15bd74da-4a1a-4b5e-956c-62ef606bb921 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Image pref 0:0:0 {{(pid=118386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 13:04:53.948784 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.virt.hardware [None req-15bd74da-4a1a-4b5e-956c-62ef606bb921 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 13:04:53.971338 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-15bd74da-4a1a-4b5e-956c-62ef606bb921 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:53.971790 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-15bd74da-4a1a-4b5e-956c-62ef606bb921 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:53.973263 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-15bd74da-4a1a-4b5e-956c-62ef606bb921 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:53.973703 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-15bd74da-4a1a-4b5e-956c-62ef606bb921 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:54.019405 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.quota [None req-15bd74da-4a1a-4b5e-956c-62ef606bb921 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Getting quotas for project 277fa3c89dff47b88894b781ff69fb70. Resources: {'instances', 'cores', 'ram'} {{(pid=118386) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 13:04:54.025753 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.quota [None req-15bd74da-4a1a-4b5e-956c-62ef606bb921 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Getting quotas for user 661062780f5c45d180a05e402fc7bc27 and project 277fa3c89dff47b88894b781ff69fb70. Resources: {'instances', 'cores', 'ram'} {{(pid=118386) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 13:04:54.102809 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-d0200883-002d-434e-96c7-3c8c7964440d tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Action: 'create', calling method: .version_select at 0x7f70de5d65e0>, body: {"keypair": {"name": "tempest-keypair-1735513436", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLK+FgS7pTo/y6XwmizhhYwo4O1F/eYz51cJWyBFNLkK60Y4FDkJ15r35lqwa+VW+3n0nhARBKLmz9kTGHh6DNKReQ24VkHMgg6RBejqnMZIt6AJ3fKiD7B/wJj8i+Izpw=="}} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:04:54.139270 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-15bd74da-4a1a-4b5e-956c-62ef606bb921 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Going to run 1 instances... {{(pid=118386) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 13:04:54.141441 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-15bd74da-4a1a-4b5e-956c-62ef606bb921 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: ba68561c-87aa-4ad8-a50c-de2cd1e938e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='46f24030-b09b-4e9c-b525-ece80dcc0197',volume_size=None,volume_type=None)] {{(pid=118386) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 13:04:54.144528 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.quota [None req-d0200883-002d-434e-96c7-3c8c7964440d tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Getting quotas for project 163f0d5f47be49f493296f228d1080a5. Resources: {'key_pairs'} {{(pid=118387) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 13:04:54.155840 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.quota [None req-d0200883-002d-434e-96c7-3c8c7964440d tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Getting quotas for user aa97e27060b3429bbad061a256db19f1 and project 163f0d5f47be49f493296f228d1080a5. Resources: {'key_pairs'} {{(pid=118387) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 13:04:54.268941 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-d0200883-002d-434e-96c7-3c8c7964440d tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.170958 Jul 05 13:04:54.270105 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 265/535] 10.222.0.36 () {60 vars in 1158 bytes} [Tue Jul 5 13:04:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 13:04:54.693035 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-15bd74da-4a1a-4b5e-956c-62ef606bb921 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.462008 Jul 05 13:04:54.695886 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 271/536] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jul 5 13:04:53 2022] POST /compute/v2.1/servers => generated 405 bytes in 1468 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 05 13:04:54.709043 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-7737a255-7e07-4603-b0c7-013f3e64e90f tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:54.710398 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-7737a255-7e07-4603-b0c7-013f3e64e90f tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: ba68561c-87aa-4ad8-a50c-de2cd1e938e2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:54.881604 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-7737a255-7e07-4603-b0c7-013f3e64e90f tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661062780f5c45d180a05e402fc7bc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277fa3c89dff47b88894b781ff69fb70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:54.897540 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-7737a255-7e07-4603-b0c7-013f3e64e90f tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/ba68561c-87aa-4ad8-a50c-de2cd1e938e2" status: 200 len: 1095 microversion: 2.1 time: 0.195854 Jul 05 13:04:54.899399 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 266/537] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:04:54 2022] GET /compute/v2.1/servers/ba68561c-87aa-4ad8-a50c-de2cd1e938e2 => generated 1095 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:04:55.915554 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-587e3347-d923-4811-85e5-168e4f6268bb tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:55.916396 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-587e3347-d923-4811-85e5-168e4f6268bb tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: ba68561c-87aa-4ad8-a50c-de2cd1e938e2] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:55.982591 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-587e3347-d923-4811-85e5-168e4f6268bb tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661062780f5c45d180a05e402fc7bc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277fa3c89dff47b88894b781ff69fb70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:55.999103 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-587e3347-d923-4811-85e5-168e4f6268bb tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/ba68561c-87aa-4ad8-a50c-de2cd1e938e2" status: 200 len: 1095 microversion: 2.1 time: 0.087448 Jul 05 13:04:56.009235 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 272/538] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:04:55 2022] GET /compute/v2.1/servers/ba68561c-87aa-4ad8-a50c-de2cd1e938e2 => generated 1095 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:04:57.016808 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-b69c7738-e152-454b-91f6-93b4b3019b89 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:57.017425 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-b69c7738-e152-454b-91f6-93b4b3019b89 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: ba68561c-87aa-4ad8-a50c-de2cd1e938e2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:57.024770 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b69c7738-e152-454b-91f6-93b4b3019b89 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:57.025225 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b69c7738-e152-454b-91f6-93b4b3019b89 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:57.026007 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b69c7738-e152-454b-91f6-93b4b3019b89 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:57.026439 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b69c7738-e152-454b-91f6-93b4b3019b89 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:57.269549 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-b69c7738-e152-454b-91f6-93b4b3019b89 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661062780f5c45d180a05e402fc7bc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277fa3c89dff47b88894b781ff69fb70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:57.277436 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-b69c7738-e152-454b-91f6-93b4b3019b89 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/ba68561c-87aa-4ad8-a50c-de2cd1e938e2" status: 200 len: 1193 microversion: 2.1 time: 0.264620 Jul 05 13:04:57.278390 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 267/539] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:04:57 2022] GET /compute/v2.1/servers/ba68561c-87aa-4ad8-a50c-de2cd1e938e2 => generated 1193 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:04:57.541769 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-c5b218e4-6d1f-4022-a9ef-1be0dfc47688 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-219269270", "imageRef": "d6134305-a5c0-4d2c-afc8-e54be21f685c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3aaa0da9-0f6f-4fc6-8a51-4d7d6726eda8"}], "security_groups": [{"name": "tempest-securitygroup--1703435967"}], "key_name": "tempest-keypair-1735513436", "user_data": "}} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:04:57.655951 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.network.neutron [None req-c5b218e4-6d1f-4022-a9ef-1be0dfc47688 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] validate_networks() for [('3aaa0da9-0f6f-4fc6-8a51-4d7d6726eda8', None, None, None, None, None)] {{(pid=118386) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 13:04:58.061041 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.virt.hardware [None req-c5b218e4-6d1f-4022-a9ef-1be0dfc47688 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Flavor limits 0:0:0 {{(pid=118386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 13:04:58.061467 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.virt.hardware [None req-c5b218e4-6d1f-4022-a9ef-1be0dfc47688 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Image limits 0:0:0 {{(pid=118386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 13:04:58.061940 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.virt.hardware [None req-c5b218e4-6d1f-4022-a9ef-1be0dfc47688 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Flavor pref 0:0:0 {{(pid=118386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 13:04:58.062353 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.virt.hardware [None req-c5b218e4-6d1f-4022-a9ef-1be0dfc47688 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Image pref 0:0:0 {{(pid=118386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 13:04:58.062758 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.virt.hardware [None req-c5b218e4-6d1f-4022-a9ef-1be0dfc47688 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 13:04:58.078783 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-c5b218e4-6d1f-4022-a9ef-1be0dfc47688 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:58.079389 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-c5b218e4-6d1f-4022-a9ef-1be0dfc47688 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:58.081210 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-c5b218e4-6d1f-4022-a9ef-1be0dfc47688 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:58.081386 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-c5b218e4-6d1f-4022-a9ef-1be0dfc47688 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:58.100316 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.quota [None req-c5b218e4-6d1f-4022-a9ef-1be0dfc47688 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Getting quotas for project 163f0d5f47be49f493296f228d1080a5. Resources: {'instances', 'cores', 'ram'} {{(pid=118386) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 13:04:58.104887 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.quota [None req-c5b218e4-6d1f-4022-a9ef-1be0dfc47688 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Getting quotas for user aa97e27060b3429bbad061a256db19f1 and project 163f0d5f47be49f493296f228d1080a5. Resources: {'instances', 'cores', 'ram'} {{(pid=118386) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 13:04:58.117742 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-c5b218e4-6d1f-4022-a9ef-1be0dfc47688 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Going to run 1 instances... {{(pid=118386) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 13:04:58.120040 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-c5b218e4-6d1f-4022-a9ef-1be0dfc47688 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: ec256177-0365-4a8e-af6c-56f68a6f9a54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d6134305-a5c0-4d2c-afc8-e54be21f685c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118386) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 13:04:58.294539 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-c1b68666-a1c9-4bde-96d8-8afbcb912c31 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:58.295176 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-c1b68666-a1c9-4bde-96d8-8afbcb912c31 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: ba68561c-87aa-4ad8-a50c-de2cd1e938e2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:58.302421 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c1b68666-a1c9-4bde-96d8-8afbcb912c31 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:58.302889 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c1b68666-a1c9-4bde-96d8-8afbcb912c31 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:58.303637 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c1b68666-a1c9-4bde-96d8-8afbcb912c31 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:58.304080 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c1b68666-a1c9-4bde-96d8-8afbcb912c31 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:58.367977 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-c1b68666-a1c9-4bde-96d8-8afbcb912c31 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661062780f5c45d180a05e402fc7bc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277fa3c89dff47b88894b781ff69fb70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:58.377897 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-c1b68666-a1c9-4bde-96d8-8afbcb912c31 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/ba68561c-87aa-4ad8-a50c-de2cd1e938e2" status: 200 len: 1211 microversion: 2.1 time: 0.085966 Jul 05 13:04:58.377897 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 268/540] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:04:58 2022] GET /compute/v2.1/servers/ba68561c-87aa-4ad8-a50c-de2cd1e938e2 => generated 1211 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:04:58.449942 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-c5b218e4-6d1f-4022-a9ef-1be0dfc47688 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.912227 Jul 05 13:04:58.452753 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 273/541] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jul 5 13:04:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 916 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 05 13:04:58.461296 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-19c088f0-9207-47cf-9f59-ab70d556fa9e tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:58.461995 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-19c088f0-9207-47cf-9f59-ab70d556fa9e tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: ec256177-0365-4a8e-af6c-56f68a6f9a54] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:58.521452 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-19c088f0-9207-47cf-9f59-ab70d556fa9e tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:58.529326 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-19c088f0-9207-47cf-9f59-ab70d556fa9e tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/ec256177-0365-4a8e-af6c-56f68a6f9a54" status: 200 len: 1241 microversion: 2.1 time: 0.071141 Jul 05 13:04:58.529648 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 269/542] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:04:58 2022] GET /compute/v2.1/servers/ec256177-0365-4a8e-af6c-56f68a6f9a54 => generated 1241 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:04:59.393968 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-ef31334f-0a67-4fa1-b581-8d4e8bb5969c tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:59.394590 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-ef31334f-0a67-4fa1-b581-8d4e8bb5969c tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: ba68561c-87aa-4ad8-a50c-de2cd1e938e2] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:59.408096 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ef31334f-0a67-4fa1-b581-8d4e8bb5969c tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:59.409846 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ef31334f-0a67-4fa1-b581-8d4e8bb5969c tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:59.409846 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ef31334f-0a67-4fa1-b581-8d4e8bb5969c tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:59.410281 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ef31334f-0a67-4fa1-b581-8d4e8bb5969c tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:59.546083 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-6a64540e-9901-481b-92d4-2b36568ba946 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:04:59.546696 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-6a64540e-9901-481b-92d4-2b36568ba946 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: ec256177-0365-4a8e-af6c-56f68a6f9a54] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:04:59.606277 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-ef31334f-0a67-4fa1-b581-8d4e8bb5969c tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661062780f5c45d180a05e402fc7bc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277fa3c89dff47b88894b781ff69fb70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:59.622405 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-ef31334f-0a67-4fa1-b581-8d4e8bb5969c tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/ba68561c-87aa-4ad8-a50c-de2cd1e938e2" status: 200 len: 1278 microversion: 2.1 time: 0.231445 Jul 05 13:04:59.623783 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 274/543] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:04:59 2022] GET /compute/v2.1/servers/ba68561c-87aa-4ad8-a50c-de2cd1e938e2 => generated 1278 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:04:59.639898 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-6a64540e-9901-481b-92d4-2b36568ba946 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:04:59.647341 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-6a64540e-9901-481b-92d4-2b36568ba946 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/ec256177-0365-4a8e-af6c-56f68a6f9a54" status: 200 len: 1241 microversion: 2.1 time: 0.105294 Jul 05 13:04:59.648059 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 270/544] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:04:59 2022] GET /compute/v2.1/servers/ec256177-0365-4a8e-af6c-56f68a6f9a54 => generated 1241 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:04:59.708253 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [req-41b4dda7-c68e-47cf-bd99-fa29d469ca38 req-e270bcd4-1ec7-4023-9990-cce186375750 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba68561c-87aa-4ad8-a50c-de2cd1e938e2", "tag": "6ed74edc-a183-4968-acd8-ac4783a16025"}]} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:04:59.719171 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-41b4dda7-c68e-47cf-bd99-fa29d469ca38 req-e270bcd4-1ec7-4023-9990-cce186375750 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:04:59.720252 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-41b4dda7-c68e-47cf-bd99-fa29d469ca38 req-e270bcd4-1ec7-4023-9990-cce186375750 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:04:59.747846 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.compute.server_external_events [req-41b4dda7-c68e-47cf-bd99-fa29d469ca38 req-e270bcd4-1ec7-4023-9990-cce186375750 service nova] Creating event network-changed:6ed74edc-a183-4968-acd8-ac4783a16025 for instance ba68561c-87aa-4ad8-a50c-de2cd1e938e2 on hv-cinder-79760 Jul 05 13:04:59.754182 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [req-41b4dda7-c68e-47cf-bd99-fa29d469ca38 req-e270bcd4-1ec7-4023-9990-cce186375750 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051124 Jul 05 13:04:59.756520 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 275/545] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:05:00.640030 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-077f0b6a-3ae8-4a3e-abcd-b369e48a432e tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:00.640709 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-077f0b6a-3ae8-4a3e-abcd-b369e48a432e tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: ba68561c-87aa-4ad8-a50c-de2cd1e938e2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:00.647923 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-077f0b6a-3ae8-4a3e-abcd-b369e48a432e tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:00.648401 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-077f0b6a-3ae8-4a3e-abcd-b369e48a432e tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:00.649295 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-077f0b6a-3ae8-4a3e-abcd-b369e48a432e tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:00.649765 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-077f0b6a-3ae8-4a3e-abcd-b369e48a432e tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:00.665409 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-ac6057ff-08ff-4812-b281-90a68a1630a0 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:00.666106 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-ac6057ff-08ff-4812-b281-90a68a1630a0 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: ec256177-0365-4a8e-af6c-56f68a6f9a54] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:00.672335 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ac6057ff-08ff-4812-b281-90a68a1630a0 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:00.672812 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ac6057ff-08ff-4812-b281-90a68a1630a0 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:00.673578 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ac6057ff-08ff-4812-b281-90a68a1630a0 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:00.674012 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ac6057ff-08ff-4812-b281-90a68a1630a0 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:00.678113 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:05:00.752820 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-ac6057ff-08ff-4812-b281-90a68a1630a0 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:00.760188 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-ac6057ff-08ff-4812-b281-90a68a1630a0 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/ec256177-0365-4a8e-af6c-56f68a6f9a54" status: 200 len: 1293 microversion: 2.1 time: 0.098938 Jul 05 13:05:00.761088 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 276/546] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:05:00 2022] GET /compute/v2.1/servers/ec256177-0365-4a8e-af6c-56f68a6f9a54 => generated 1293 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:05:00.810727 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-077f0b6a-3ae8-4a3e-abcd-b369e48a432e tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661062780f5c45d180a05e402fc7bc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277fa3c89dff47b88894b781ff69fb70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:00.818373 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-077f0b6a-3ae8-4a3e-abcd-b369e48a432e tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/ba68561c-87aa-4ad8-a50c-de2cd1e938e2" status: 200 len: 1266 microversion: 2.1 time: 0.182303 Jul 05 13:05:00.818945 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 271/547] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:05:00 2022] GET /compute/v2.1/servers/ba68561c-87aa-4ad8-a50c-de2cd1e938e2 => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:05:01.785359 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-90e44ce3-2e38-44ab-9565-6b6171e79174 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:01.786093 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-90e44ce3-2e38-44ab-9565-6b6171e79174 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: ec256177-0365-4a8e-af6c-56f68a6f9a54] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:01.788274 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:05:01.793874 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-90e44ce3-2e38-44ab-9565-6b6171e79174 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:01.794668 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-90e44ce3-2e38-44ab-9565-6b6171e79174 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:01.795682 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-90e44ce3-2e38-44ab-9565-6b6171e79174 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:01.796218 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-90e44ce3-2e38-44ab-9565-6b6171e79174 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:01.835842 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-9af6033d-b5cb-49e3-b440-913a6b0d503f tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:01.836682 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-9af6033d-b5cb-49e3-b440-913a6b0d503f tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: ba68561c-87aa-4ad8-a50c-de2cd1e938e2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:01.843371 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9af6033d-b5cb-49e3-b440-913a6b0d503f tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:01.846200 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9af6033d-b5cb-49e3-b440-913a6b0d503f tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:01.847440 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9af6033d-b5cb-49e3-b440-913a6b0d503f tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:01.848093 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9af6033d-b5cb-49e3-b440-913a6b0d503f tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:01.899664 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-90e44ce3-2e38-44ab-9565-6b6171e79174 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:01.913728 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-90e44ce3-2e38-44ab-9565-6b6171e79174 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/ec256177-0365-4a8e-af6c-56f68a6f9a54" status: 200 len: 1311 microversion: 2.1 time: 0.131940 Jul 05 13:05:01.914848 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 277/548] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:05:01 2022] GET /compute/v2.1/servers/ec256177-0365-4a8e-af6c-56f68a6f9a54 => generated 1311 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:05:02.009313 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-9af6033d-b5cb-49e3-b440-913a6b0d503f tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661062780f5c45d180a05e402fc7bc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277fa3c89dff47b88894b781ff69fb70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:02.016817 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-9af6033d-b5cb-49e3-b440-913a6b0d503f tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/ba68561c-87aa-4ad8-a50c-de2cd1e938e2" status: 200 len: 1266 microversion: 2.1 time: 0.184803 Jul 05 13:05:02.028282 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 272/549] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:05:01 2022] GET /compute/v2.1/servers/ba68561c-87aa-4ad8-a50c-de2cd1e938e2 => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:05:02.930852 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-61f4fd31-487c-4942-a881-b68856546a29 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:02.931602 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-61f4fd31-487c-4942-a881-b68856546a29 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: ec256177-0365-4a8e-af6c-56f68a6f9a54] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:02.941259 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-61f4fd31-487c-4942-a881-b68856546a29 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:02.941825 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-61f4fd31-487c-4942-a881-b68856546a29 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:02.942680 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-61f4fd31-487c-4942-a881-b68856546a29 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:02.944652 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-61f4fd31-487c-4942-a881-b68856546a29 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:03.040029 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-6e2e5558-1197-42bc-9169-8096bc1964ed tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:03.043461 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-6e2e5558-1197-42bc-9169-8096bc1964ed tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: ba68561c-87aa-4ad8-a50c-de2cd1e938e2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:03.078726 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6e2e5558-1197-42bc-9169-8096bc1964ed tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:03.078966 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6e2e5558-1197-42bc-9169-8096bc1964ed tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:03.081442 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6e2e5558-1197-42bc-9169-8096bc1964ed tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:03.082212 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6e2e5558-1197-42bc-9169-8096bc1964ed tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:03.100006 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-61f4fd31-487c-4942-a881-b68856546a29 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:03.113569 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-61f4fd31-487c-4942-a881-b68856546a29 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/ec256177-0365-4a8e-af6c-56f68a6f9a54" status: 200 len: 1367 microversion: 2.1 time: 0.186475 Jul 05 13:05:03.126357 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 278/550] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:05:02 2022] GET /compute/v2.1/servers/ec256177-0365-4a8e-af6c-56f68a6f9a54 => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:05:03.257998 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-6e2e5558-1197-42bc-9169-8096bc1964ed tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661062780f5c45d180a05e402fc7bc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277fa3c89dff47b88894b781ff69fb70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:03.267018 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-6e2e5558-1197-42bc-9169-8096bc1964ed tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/ba68561c-87aa-4ad8-a50c-de2cd1e938e2" status: 200 len: 1266 microversion: 2.1 time: 0.235444 Jul 05 13:05:03.269072 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 273/551] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:05:03 2022] GET /compute/v2.1/servers/ba68561c-87aa-4ad8-a50c-de2cd1e938e2 => generated 1266 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:05:03.747579 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [req-7da3e228-9815-4fb4-90b8-aa4e60afd174 req-0bb59934-3ef1-41e2-ad40-a7bd86efcaf5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec256177-0365-4a8e-af6c-56f68a6f9a54", "tag": "606c57ab-1e76-4fd5-a780-b78e616e251d"}]} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:05:03.757678 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-7da3e228-9815-4fb4-90b8-aa4e60afd174 req-0bb59934-3ef1-41e2-ad40-a7bd86efcaf5 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:03.759415 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-7da3e228-9815-4fb4-90b8-aa4e60afd174 req-0bb59934-3ef1-41e2-ad40-a7bd86efcaf5 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:03.770912 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.compute.server_external_events [req-7da3e228-9815-4fb4-90b8-aa4e60afd174 req-0bb59934-3ef1-41e2-ad40-a7bd86efcaf5 service nova] Creating event network-changed:606c57ab-1e76-4fd5-a780-b78e616e251d for instance ec256177-0365-4a8e-af6c-56f68a6f9a54 on hv-cinder-79760 Jul 05 13:05:03.775800 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [req-7da3e228-9815-4fb4-90b8-aa4e60afd174 req-0bb59934-3ef1-41e2-ad40-a7bd86efcaf5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032072 Jul 05 13:05:03.776461 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 279/552] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:05:04.138828 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-ac502088-b22a-4df1-a6b1-60d25c28be23 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:04.139650 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-ac502088-b22a-4df1-a6b1-60d25c28be23 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: ec256177-0365-4a8e-af6c-56f68a6f9a54] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:04.146414 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ac502088-b22a-4df1-a6b1-60d25c28be23 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:04.146950 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ac502088-b22a-4df1-a6b1-60d25c28be23 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:04.147636 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ac502088-b22a-4df1-a6b1-60d25c28be23 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:04.148068 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ac502088-b22a-4df1-a6b1-60d25c28be23 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:04.281525 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-ac502088-b22a-4df1-a6b1-60d25c28be23 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:04.287123 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-2bcaff14-83f0-4d09-abd3-cf7af23a20e5 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:04.287820 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-2bcaff14-83f0-4d09-abd3-cf7af23a20e5 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: ba68561c-87aa-4ad8-a50c-de2cd1e938e2] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:04.291295 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-ac502088-b22a-4df1-a6b1-60d25c28be23 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/ec256177-0365-4a8e-af6c-56f68a6f9a54" status: 200 len: 1367 microversion: 2.1 time: 0.156243 Jul 05 13:05:04.297833 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 274/553] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:05:04 2022] GET /compute/v2.1/servers/ec256177-0365-4a8e-af6c-56f68a6f9a54 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:05:04.298158 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-2bcaff14-83f0-4d09-abd3-cf7af23a20e5 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:04.298158 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-2bcaff14-83f0-4d09-abd3-cf7af23a20e5 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:04.298158 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-2bcaff14-83f0-4d09-abd3-cf7af23a20e5 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:04.298158 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-2bcaff14-83f0-4d09-abd3-cf7af23a20e5 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:04.386309 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-b7468516-8250-432e-962e-13679e52cf0f tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "055e4eb6-4954-4d2b-b41a-8a296f54ac26"}} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:05:04.387516 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-b7468516-8250-432e-962e-13679e52cf0f tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 7b7f15b2-a00e-4172-983d-f2a80401953b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:04.394822 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b7468516-8250-432e-962e-13679e52cf0f tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:04.395275 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b7468516-8250-432e-962e-13679e52cf0f tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:04.398192 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b7468516-8250-432e-962e-13679e52cf0f tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:04.398192 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b7468516-8250-432e-962e-13679e52cf0f tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:04.472690 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-2bcaff14-83f0-4d09-abd3-cf7af23a20e5 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661062780f5c45d180a05e402fc7bc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277fa3c89dff47b88894b781ff69fb70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:04.483359 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-2bcaff14-83f0-4d09-abd3-cf7af23a20e5 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/ba68561c-87aa-4ad8-a50c-de2cd1e938e2" status: 200 len: 1266 microversion: 2.1 time: 0.201198 Jul 05 13:05:04.484238 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 280/554] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:05:04 2022] GET /compute/v2.1/servers/ba68561c-87aa-4ad8-a50c-de2cd1e938e2 => generated 1266 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:05:05.307450 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-e6083f52-d698-4538-8083-5722e9ecdcc9 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:05.308116 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-e6083f52-d698-4538-8083-5722e9ecdcc9 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: ec256177-0365-4a8e-af6c-56f68a6f9a54] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:05.316450 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e6083f52-d698-4538-8083-5722e9ecdcc9 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:05.316926 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e6083f52-d698-4538-8083-5722e9ecdcc9 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:05.317685 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e6083f52-d698-4538-8083-5722e9ecdcc9 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:05.318180 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e6083f52-d698-4538-8083-5722e9ecdcc9 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:05.451586 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-e6083f52-d698-4538-8083-5722e9ecdcc9 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:05.459677 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-e6083f52-d698-4538-8083-5722e9ecdcc9 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/ec256177-0365-4a8e-af6c-56f68a6f9a54" status: 200 len: 1367 microversion: 2.1 time: 0.156209 Jul 05 13:05:05.460238 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 281/555] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:05:05 2022] GET /compute/v2.1/servers/ec256177-0365-4a8e-af6c-56f68a6f9a54 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:05:05.499155 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-e7c7df31-36e2-479e-8632-f8a3ca95c634 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:05.500037 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-e7c7df31-36e2-479e-8632-f8a3ca95c634 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: ba68561c-87aa-4ad8-a50c-de2cd1e938e2] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:05.506405 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e7c7df31-36e2-479e-8632-f8a3ca95c634 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:05.506852 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e7c7df31-36e2-479e-8632-f8a3ca95c634 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:05.507640 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e7c7df31-36e2-479e-8632-f8a3ca95c634 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:05.508072 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e7c7df31-36e2-479e-8632-f8a3ca95c634 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:05.639950 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-e7c7df31-36e2-479e-8632-f8a3ca95c634 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661062780f5c45d180a05e402fc7bc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277fa3c89dff47b88894b781ff69fb70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:05.649020 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-e7c7df31-36e2-479e-8632-f8a3ca95c634 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/ba68561c-87aa-4ad8-a50c-de2cd1e938e2" status: 200 len: 1266 microversion: 2.1 time: 0.153055 Jul 05 13:05:05.649520 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 282/556] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:05:05 2022] GET /compute/v2.1/servers/ba68561c-87aa-4ad8-a50c-de2cd1e938e2 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:05:06.082149 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:05:06.303954 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-b7468516-8250-432e-962e-13679e52cf0f tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "POST /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.921508 Jul 05 13:05:06.304570 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 275/557] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Jul 5 13:05:04 2022] POST /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b/os-volume_attachments => generated 194 bytes in 1923 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:05:06.476624 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-527c3e31-c627-43d3-80f6-f3f50f632408 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:06.477160 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-527c3e31-c627-43d3-80f6-f3f50f632408 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: ec256177-0365-4a8e-af6c-56f68a6f9a54] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:06.483466 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-527c3e31-c627-43d3-80f6-f3f50f632408 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:06.483907 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-527c3e31-c627-43d3-80f6-f3f50f632408 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:06.484690 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-527c3e31-c627-43d3-80f6-f3f50f632408 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:06.485120 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-527c3e31-c627-43d3-80f6-f3f50f632408 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:06.662339 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-527c3e31-c627-43d3-80f6-f3f50f632408 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:06.669877 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-527c3e31-c627-43d3-80f6-f3f50f632408 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/ec256177-0365-4a8e-af6c-56f68a6f9a54" status: 200 len: 1367 microversion: 2.1 time: 0.197152 Jul 05 13:05:06.671135 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 283/558] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:05:06 2022] GET /compute/v2.1/servers/ec256177-0365-4a8e-af6c-56f68a6f9a54 => generated 1367 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:05:06.684726 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-018f5011-df67-400e-b717-3c90fa76c90c tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:06.685434 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-018f5011-df67-400e-b717-3c90fa76c90c tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: ba68561c-87aa-4ad8-a50c-de2cd1e938e2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:06.692717 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-018f5011-df67-400e-b717-3c90fa76c90c tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:06.693626 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-018f5011-df67-400e-b717-3c90fa76c90c tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:06.694037 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-018f5011-df67-400e-b717-3c90fa76c90c tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:06.694473 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-018f5011-df67-400e-b717-3c90fa76c90c tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:06.884964 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-018f5011-df67-400e-b717-3c90fa76c90c tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661062780f5c45d180a05e402fc7bc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277fa3c89dff47b88894b781ff69fb70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:06.894700 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-018f5011-df67-400e-b717-3c90fa76c90c tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/ba68561c-87aa-4ad8-a50c-de2cd1e938e2" status: 200 len: 1266 microversion: 2.1 time: 0.214728 Jul 05 13:05:06.904083 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 276/559] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:05:06 2022] GET /compute/v2.1/servers/ba68561c-87aa-4ad8-a50c-de2cd1e938e2 => generated 1266 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:05:07.686141 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-b00c5580-74fd-4248-a63a-11bc15db1d95 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:07.686693 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-b00c5580-74fd-4248-a63a-11bc15db1d95 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: ec256177-0365-4a8e-af6c-56f68a6f9a54] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:07.693130 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b00c5580-74fd-4248-a63a-11bc15db1d95 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:07.693580 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b00c5580-74fd-4248-a63a-11bc15db1d95 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:07.694335 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b00c5580-74fd-4248-a63a-11bc15db1d95 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:07.694746 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b00c5580-74fd-4248-a63a-11bc15db1d95 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:07.827279 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-b00c5580-74fd-4248-a63a-11bc15db1d95 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:07.835136 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-b00c5580-74fd-4248-a63a-11bc15db1d95 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/ec256177-0365-4a8e-af6c-56f68a6f9a54" status: 200 len: 1367 microversion: 2.1 time: 0.152868 Jul 05 13:05:07.835823 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 284/560] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:05:07 2022] GET /compute/v2.1/servers/ec256177-0365-4a8e-af6c-56f68a6f9a54 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:05:07.911139 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-beed5c15-8f23-45d9-924c-367cc3fdfec0 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:07.911886 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-beed5c15-8f23-45d9-924c-367cc3fdfec0 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: ba68561c-87aa-4ad8-a50c-de2cd1e938e2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:07.918462 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-beed5c15-8f23-45d9-924c-367cc3fdfec0 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:07.918909 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-beed5c15-8f23-45d9-924c-367cc3fdfec0 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:07.919677 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-beed5c15-8f23-45d9-924c-367cc3fdfec0 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:07.920109 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-beed5c15-8f23-45d9-924c-367cc3fdfec0 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:08.055830 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-beed5c15-8f23-45d9-924c-367cc3fdfec0 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661062780f5c45d180a05e402fc7bc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277fa3c89dff47b88894b781ff69fb70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:08.070347 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-beed5c15-8f23-45d9-924c-367cc3fdfec0 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/ba68561c-87aa-4ad8-a50c-de2cd1e938e2" status: 200 len: 1266 microversion: 2.1 time: 0.162955 Jul 05 13:05:08.071038 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 277/561] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:05:07 2022] GET /compute/v2.1/servers/ba68561c-87aa-4ad8-a50c-de2cd1e938e2 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:05:08.851986 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-96efc278-7b7c-4fd8-b600-d0510d795c4b tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:08.852607 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-96efc278-7b7c-4fd8-b600-d0510d795c4b tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: ec256177-0365-4a8e-af6c-56f68a6f9a54] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:08.854842 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_cell0:SELECT=4 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:05:08.855526 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_cell0:SELECT=14 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:05:08.860464 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-96efc278-7b7c-4fd8-b600-d0510d795c4b tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:08.861118 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-96efc278-7b7c-4fd8-b600-d0510d795c4b tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:08.861867 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-96efc278-7b7c-4fd8-b600-d0510d795c4b tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:08.862459 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-96efc278-7b7c-4fd8-b600-d0510d795c4b tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:09.001290 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-96efc278-7b7c-4fd8-b600-d0510d795c4b tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:09.009077 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-96efc278-7b7c-4fd8-b600-d0510d795c4b tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/ec256177-0365-4a8e-af6c-56f68a6f9a54" status: 200 len: 1367 microversion: 2.1 time: 0.160968 Jul 05 13:05:09.018676 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 285/562] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:05:08 2022] GET /compute/v2.1/servers/ec256177-0365-4a8e-af6c-56f68a6f9a54 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:05:09.092766 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-fdb5531f-56f0-46ee-9eb1-147da9ed59b7 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:09.092766 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-fdb5531f-56f0-46ee-9eb1-147da9ed59b7 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: ba68561c-87aa-4ad8-a50c-de2cd1e938e2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:09.100420 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-fdb5531f-56f0-46ee-9eb1-147da9ed59b7 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:09.101032 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-fdb5531f-56f0-46ee-9eb1-147da9ed59b7 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:09.102574 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-fdb5531f-56f0-46ee-9eb1-147da9ed59b7 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:09.102574 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-fdb5531f-56f0-46ee-9eb1-147da9ed59b7 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:09.221037 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [req-1a7ebdd9-e734-4ea1-b474-905334ed4488 req-623190c0-1626-44c7-8cf3-184b972803fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec256177-0365-4a8e-af6c-56f68a6f9a54", "name": "network-vif-plugged", "status": "completed", "tag": "606c57ab-1e76-4fd5-a780-b78e616e251d"}]} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:05:09.231948 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-1a7ebdd9-e734-4ea1-b474-905334ed4488 req-623190c0-1626-44c7-8cf3-184b972803fe service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:09.232406 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-1a7ebdd9-e734-4ea1-b474-905334ed4488 req-623190c0-1626-44c7-8cf3-184b972803fe service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:09.244009 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.compute.server_external_events [req-1a7ebdd9-e734-4ea1-b474-905334ed4488 req-623190c0-1626-44c7-8cf3-184b972803fe service nova] Creating event network-vif-plugged:606c57ab-1e76-4fd5-a780-b78e616e251d for instance ec256177-0365-4a8e-af6c-56f68a6f9a54 on hv-cinder-79760 Jul 05 13:05:09.249106 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [req-1a7ebdd9-e734-4ea1-b474-905334ed4488 req-623190c0-1626-44c7-8cf3-184b972803fe service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031622 Jul 05 13:05:09.249679 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 286/563] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:05:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 13:05:09.274679 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-fdb5531f-56f0-46ee-9eb1-147da9ed59b7 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661062780f5c45d180a05e402fc7bc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277fa3c89dff47b88894b781ff69fb70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:09.282719 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-fdb5531f-56f0-46ee-9eb1-147da9ed59b7 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/ba68561c-87aa-4ad8-a50c-de2cd1e938e2" status: 200 len: 1266 microversion: 2.1 time: 0.196557 Jul 05 13:05:09.283602 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 278/564] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:05:09 2022] GET /compute/v2.1/servers/ba68561c-87aa-4ad8-a50c-de2cd1e938e2 => generated 1266 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:05:10.026761 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-23fd84da-f18e-4a9b-b1da-7316ab526e09 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:10.027499 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-23fd84da-f18e-4a9b-b1da-7316ab526e09 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: ec256177-0365-4a8e-af6c-56f68a6f9a54] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:10.034348 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-23fd84da-f18e-4a9b-b1da-7316ab526e09 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:10.034797 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-23fd84da-f18e-4a9b-b1da-7316ab526e09 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:10.035559 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-23fd84da-f18e-4a9b-b1da-7316ab526e09 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:10.035991 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-23fd84da-f18e-4a9b-b1da-7316ab526e09 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:10.169479 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-23fd84da-f18e-4a9b-b1da-7316ab526e09 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:10.177881 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-23fd84da-f18e-4a9b-b1da-7316ab526e09 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/ec256177-0365-4a8e-af6c-56f68a6f9a54" status: 200 len: 1367 microversion: 2.1 time: 0.155279 Jul 05 13:05:10.178736 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 287/565] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:05:10 2022] GET /compute/v2.1/servers/ec256177-0365-4a8e-af6c-56f68a6f9a54 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:05:10.308761 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-ddff36c3-4780-4613-a2c0-2e2dee8080ac tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:10.309369 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-ddff36c3-4780-4613-a2c0-2e2dee8080ac tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: ba68561c-87aa-4ad8-a50c-de2cd1e938e2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:10.311319 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell0:SELECT=10 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:05:10.317832 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ddff36c3-4780-4613-a2c0-2e2dee8080ac tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:10.318274 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ddff36c3-4780-4613-a2c0-2e2dee8080ac tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:10.319152 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ddff36c3-4780-4613-a2c0-2e2dee8080ac tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:10.319579 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ddff36c3-4780-4613-a2c0-2e2dee8080ac tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:10.457583 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-ddff36c3-4780-4613-a2c0-2e2dee8080ac tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661062780f5c45d180a05e402fc7bc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277fa3c89dff47b88894b781ff69fb70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:10.464902 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-ddff36c3-4780-4613-a2c0-2e2dee8080ac tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/ba68561c-87aa-4ad8-a50c-de2cd1e938e2" status: 200 len: 1266 microversion: 2.1 time: 0.160097 Jul 05 13:05:10.465461 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 279/566] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:05:10 2022] GET /compute/v2.1/servers/ba68561c-87aa-4ad8-a50c-de2cd1e938e2 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:05:11.195184 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-b59bd473-7b0a-4dca-81b2-d84622c9d0f9 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:11.195721 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-b59bd473-7b0a-4dca-81b2-d84622c9d0f9 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: ec256177-0365-4a8e-af6c-56f68a6f9a54] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:11.201818 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b59bd473-7b0a-4dca-81b2-d84622c9d0f9 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:11.202206 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b59bd473-7b0a-4dca-81b2-d84622c9d0f9 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:11.203093 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b59bd473-7b0a-4dca-81b2-d84622c9d0f9 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:11.203531 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b59bd473-7b0a-4dca-81b2-d84622c9d0f9 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:11.264605 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-3bde8e02-60b0-47b6-bee9-ffcb1efb4df5 req-7ba0e1b2-8616-44f4-b459-51e4deba8a44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba68561c-87aa-4ad8-a50c-de2cd1e938e2", "name": "network-vif-plugged", "status": "completed", "tag": "6ed74edc-a183-4968-acd8-ac4783a16025"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:05:11.273994 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-3bde8e02-60b0-47b6-bee9-ffcb1efb4df5 req-7ba0e1b2-8616-44f4-b459-51e4deba8a44 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:11.274527 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-3bde8e02-60b0-47b6-bee9-ffcb1efb4df5 req-7ba0e1b2-8616-44f4-b459-51e4deba8a44 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:11.293254 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-3bde8e02-60b0-47b6-bee9-ffcb1efb4df5 req-7ba0e1b2-8616-44f4-b459-51e4deba8a44 service nova] Creating event network-vif-plugged:6ed74edc-a183-4968-acd8-ac4783a16025 for instance ba68561c-87aa-4ad8-a50c-de2cd1e938e2 on hv-cinder-79760 Jul 05 13:05:11.298377 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-3bde8e02-60b0-47b6-bee9-ffcb1efb4df5 req-7ba0e1b2-8616-44f4-b459-51e4deba8a44 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037647 Jul 05 13:05:11.299148 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 280/567] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:05:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 13:05:11.337640 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-b59bd473-7b0a-4dca-81b2-d84622c9d0f9 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:11.345229 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-b59bd473-7b0a-4dca-81b2-d84622c9d0f9 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/ec256177-0365-4a8e-af6c-56f68a6f9a54" status: 200 len: 1367 microversion: 2.1 time: 0.154083 Jul 05 13:05:11.347277 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 288/568] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:05:11 2022] GET /compute/v2.1/servers/ec256177-0365-4a8e-af6c-56f68a6f9a54 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:05:11.483321 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-a54c094f-ee8b-497d-8ed2-450714f1d5df tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:11.483830 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-a54c094f-ee8b-497d-8ed2-450714f1d5df tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: ba68561c-87aa-4ad8-a50c-de2cd1e938e2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:11.490460 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a54c094f-ee8b-497d-8ed2-450714f1d5df tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:11.490820 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a54c094f-ee8b-497d-8ed2-450714f1d5df tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:11.491975 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a54c094f-ee8b-497d-8ed2-450714f1d5df tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:11.492313 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a54c094f-ee8b-497d-8ed2-450714f1d5df tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:11.630527 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-a54c094f-ee8b-497d-8ed2-450714f1d5df tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661062780f5c45d180a05e402fc7bc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277fa3c89dff47b88894b781ff69fb70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:11.635783 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-a54c094f-ee8b-497d-8ed2-450714f1d5df tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/ba68561c-87aa-4ad8-a50c-de2cd1e938e2" status: 200 len: 1266 microversion: 2.1 time: 0.157574 Jul 05 13:05:11.636837 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 281/569] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:05:11 2022] GET /compute/v2.1/servers/ba68561c-87aa-4ad8-a50c-de2cd1e938e2 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:05:12.363223 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-09bfc9e3-8925-432b-ba1d-1dbbbdc56e3d tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:12.363758 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-09bfc9e3-8925-432b-ba1d-1dbbbdc56e3d tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: ec256177-0365-4a8e-af6c-56f68a6f9a54] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:12.369697 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-09bfc9e3-8925-432b-ba1d-1dbbbdc56e3d tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:12.370142 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-09bfc9e3-8925-432b-ba1d-1dbbbdc56e3d tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:12.370890 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-09bfc9e3-8925-432b-ba1d-1dbbbdc56e3d tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:12.371320 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-09bfc9e3-8925-432b-ba1d-1dbbbdc56e3d tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:12.501364 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-09bfc9e3-8925-432b-ba1d-1dbbbdc56e3d tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:12.509425 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-09bfc9e3-8925-432b-ba1d-1dbbbdc56e3d tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/ec256177-0365-4a8e-af6c-56f68a6f9a54" status: 200 len: 1558 microversion: 2.1 time: 0.150172 Jul 05 13:05:12.509986 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 289/570] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:05:12 2022] GET /compute/v2.1/servers/ec256177-0365-4a8e-af6c-56f68a6f9a54 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:05:12.526065 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-2280665c-b141-4c74-87b4-3919a615a254 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:12.526563 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-2280665c-b141-4c74-87b4-3919a615a254 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: ec256177-0365-4a8e-af6c-56f68a6f9a54] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:12.533104 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2280665c-b141-4c74-87b4-3919a615a254 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:12.533548 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2280665c-b141-4c74-87b4-3919a615a254 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:12.534296 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2280665c-b141-4c74-87b4-3919a615a254 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:12.534723 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2280665c-b141-4c74-87b4-3919a615a254 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:12.611793 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-2280665c-b141-4c74-87b4-3919a615a254 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/ec256177-0365-4a8e-af6c-56f68a6f9a54/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089786 Jul 05 13:05:12.612379 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 282/571] 10.222.0.36 () {58 vars in 1274 bytes} [Tue Jul 5 13:05:12 2022] GET /compute/v2.1/servers/ec256177-0365-4a8e-af6c-56f68a6f9a54/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:05:12.652871 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-35bc966d-c556-4c35-84a1-38f6f05905b7 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:12.654271 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-35bc966d-c556-4c35-84a1-38f6f05905b7 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: ba68561c-87aa-4ad8-a50c-de2cd1e938e2] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:12.660825 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-35bc966d-c556-4c35-84a1-38f6f05905b7 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:12.661275 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-35bc966d-c556-4c35-84a1-38f6f05905b7 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:12.662125 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-35bc966d-c556-4c35-84a1-38f6f05905b7 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:12.662529 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-35bc966d-c556-4c35-84a1-38f6f05905b7 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:12.801582 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-35bc966d-c556-4c35-84a1-38f6f05905b7 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661062780f5c45d180a05e402fc7bc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277fa3c89dff47b88894b781ff69fb70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:12.808935 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-35bc966d-c556-4c35-84a1-38f6f05905b7 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/ba68561c-87aa-4ad8-a50c-de2cd1e938e2" status: 200 len: 1266 microversion: 2.1 time: 0.159971 Jul 05 13:05:12.809490 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 290/572] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:05:12 2022] GET /compute/v2.1/servers/ba68561c-87aa-4ad8-a50c-de2cd1e938e2 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:05:12.966961 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-49b194b1-fdde-4557-89cb-589033e950c2 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1510441786", "imageRef": "d6134305-a5c0-4d2c-afc8-e54be21f685c", "flavorRef": "452"}} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:05:13.020721 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.network.neutron [None req-49b194b1-fdde-4557-89cb-589033e950c2 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] validate_networks() for None {{(pid=118387) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 13:05:13.309498 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-49b194b1-fdde-4557-89cb-589033e950c2 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Flavor limits 0:0:0 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 13:05:13.316027 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-49b194b1-fdde-4557-89cb-589033e950c2 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Image limits 0:0:0 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 13:05:13.316027 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-49b194b1-fdde-4557-89cb-589033e950c2 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Flavor pref 0:0:0 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 13:05:13.316027 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-49b194b1-fdde-4557-89cb-589033e950c2 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Image pref 0:0:0 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 13:05:13.316027 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-49b194b1-fdde-4557-89cb-589033e950c2 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 13:05:13.321903 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-49b194b1-fdde-4557-89cb-589033e950c2 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:13.322460 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-49b194b1-fdde-4557-89cb-589033e950c2 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:13.323324 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-49b194b1-fdde-4557-89cb-589033e950c2 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:13.323762 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-49b194b1-fdde-4557-89cb-589033e950c2 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:13.340305 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.quota [None req-49b194b1-fdde-4557-89cb-589033e950c2 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Getting quotas for project 85af5c12238140c4a6334d9b3256f664. Resources: {'instances', 'cores', 'ram'} {{(pid=118387) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 13:05:13.344460 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.quota [None req-49b194b1-fdde-4557-89cb-589033e950c2 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Getting quotas for user a316766a5e5e490189884369d59c74d7 and project 85af5c12238140c4a6334d9b3256f664. Resources: {'instances', 'cores', 'ram'} {{(pid=118387) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 13:05:13.356011 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-49b194b1-fdde-4557-89cb-589033e950c2 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Going to run 1 instances... {{(pid=118387) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 13:05:13.358495 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-49b194b1-fdde-4557-89cb-589033e950c2 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] [instance: fa513f2e-6870-4880-b3bf-d4f31e6d0156] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d6134305-a5c0-4d2c-afc8-e54be21f685c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118387) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 13:05:13.556038 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-49b194b1-fdde-4557-89cb-589033e950c2 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.592803 Jul 05 13:05:13.562549 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 283/573] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jul 5 13:05:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 05 13:05:13.568284 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-ebaa3216-ebf7-425a-b5b7-e451ca58553e tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:13.568943 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-ebaa3216-ebf7-425a-b5b7-e451ca58553e tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] [instance: fa513f2e-6870-4880-b3bf-d4f31e6d0156] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:13.638496 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-ebaa3216-ebf7-425a-b5b7-e451ca58553e tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a316766a5e5e490189884369d59c74d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85af5c12238140c4a6334d9b3256f664', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:13.646667 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-ebaa3216-ebf7-425a-b5b7-e451ca58553e tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] 10.222.0.36 "GET /compute/v2.1/servers/fa513f2e-6870-4880-b3bf-d4f31e6d0156" status: 200 len: 1215 microversion: 2.1 time: 0.083108 Jul 05 13:05:13.647491 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 291/574] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:05:13 2022] GET /compute/v2.1/servers/fa513f2e-6870-4880-b3bf-d4f31e6d0156 => generated 1215 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:05:13.710843 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-e23f137a-24a9-4f4c-afa6-574de30e005d req-882bef4a-b07a-4f19-9bd5-e0882728555e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec256177-0365-4a8e-af6c-56f68a6f9a54", "tag": "606c57ab-1e76-4fd5-a780-b78e616e251d"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:05:13.719672 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-e23f137a-24a9-4f4c-afa6-574de30e005d req-882bef4a-b07a-4f19-9bd5-e0882728555e service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:13.720369 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-e23f137a-24a9-4f4c-afa6-574de30e005d req-882bef4a-b07a-4f19-9bd5-e0882728555e service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:13.733743 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-e23f137a-24a9-4f4c-afa6-574de30e005d req-882bef4a-b07a-4f19-9bd5-e0882728555e service nova] Creating event network-changed:606c57ab-1e76-4fd5-a780-b78e616e251d for instance ec256177-0365-4a8e-af6c-56f68a6f9a54 on hv-cinder-79760 Jul 05 13:05:13.741622 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-e23f137a-24a9-4f4c-afa6-574de30e005d req-882bef4a-b07a-4f19-9bd5-e0882728555e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034004 Jul 05 13:05:13.742564 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 284/575] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:05:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:05:13.826761 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-415d0bc8-53a3-45c0-be8e-31f2dd1f6412 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:13.827278 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-415d0bc8-53a3-45c0-be8e-31f2dd1f6412 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: ba68561c-87aa-4ad8-a50c-de2cd1e938e2] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:13.835182 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-415d0bc8-53a3-45c0-be8e-31f2dd1f6412 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:13.835864 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-415d0bc8-53a3-45c0-be8e-31f2dd1f6412 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:13.837217 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-415d0bc8-53a3-45c0-be8e-31f2dd1f6412 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:13.837845 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-415d0bc8-53a3-45c0-be8e-31f2dd1f6412 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:13.982217 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-415d0bc8-53a3-45c0-be8e-31f2dd1f6412 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661062780f5c45d180a05e402fc7bc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277fa3c89dff47b88894b781ff69fb70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:13.990372 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-415d0bc8-53a3-45c0-be8e-31f2dd1f6412 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/ba68561c-87aa-4ad8-a50c-de2cd1e938e2" status: 200 len: 1266 microversion: 2.1 time: 0.167748 Jul 05 13:05:13.990933 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 292/576] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:05:13 2022] GET /compute/v2.1/servers/ba68561c-87aa-4ad8-a50c-de2cd1e938e2 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:05:14.663944 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-8c148dbc-ae30-4350-944d-c80f669d8dc3 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:14.664835 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-8c148dbc-ae30-4350-944d-c80f669d8dc3 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] [instance: fa513f2e-6870-4880-b3bf-d4f31e6d0156] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:14.727124 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-8c148dbc-ae30-4350-944d-c80f669d8dc3 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a316766a5e5e490189884369d59c74d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85af5c12238140c4a6334d9b3256f664', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:14.735116 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-8c148dbc-ae30-4350-944d-c80f669d8dc3 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] 10.222.0.36 "GET /compute/v2.1/servers/fa513f2e-6870-4880-b3bf-d4f31e6d0156" status: 200 len: 1215 microversion: 2.1 time: 0.075245 Jul 05 13:05:14.737061 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 285/577] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:05:14 2022] GET /compute/v2.1/servers/fa513f2e-6870-4880-b3bf-d4f31e6d0156 => generated 1215 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:05:15.006775 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-ff5fd4ea-eca8-4a80-84be-b0c2c38e2d22 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:15.007376 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-ff5fd4ea-eca8-4a80-84be-b0c2c38e2d22 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: ba68561c-87aa-4ad8-a50c-de2cd1e938e2] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:15.013475 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ff5fd4ea-eca8-4a80-84be-b0c2c38e2d22 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:15.013969 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ff5fd4ea-eca8-4a80-84be-b0c2c38e2d22 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:15.014721 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ff5fd4ea-eca8-4a80-84be-b0c2c38e2d22 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:15.015155 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ff5fd4ea-eca8-4a80-84be-b0c2c38e2d22 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:15.166735 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-ff5fd4ea-eca8-4a80-84be-b0c2c38e2d22 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661062780f5c45d180a05e402fc7bc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277fa3c89dff47b88894b781ff69fb70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:15.174455 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-ff5fd4ea-eca8-4a80-84be-b0c2c38e2d22 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/ba68561c-87aa-4ad8-a50c-de2cd1e938e2" status: 200 len: 1453 microversion: 2.1 time: 0.171672 Jul 05 13:05:15.175021 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 293/578] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:05:15 2022] GET /compute/v2.1/servers/ba68561c-87aa-4ad8-a50c-de2cd1e938e2 => generated 1453 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:05:15.191661 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-b370f70d-d84b-4c19-a574-0c5077651554 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:15.192740 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-b370f70d-d84b-4c19-a574-0c5077651554 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: ba68561c-87aa-4ad8-a50c-de2cd1e938e2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:15.198906 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b370f70d-d84b-4c19-a574-0c5077651554 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:15.199355 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b370f70d-d84b-4c19-a574-0c5077651554 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:15.200114 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b370f70d-d84b-4c19-a574-0c5077651554 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:15.200550 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b370f70d-d84b-4c19-a574-0c5077651554 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:15.333396 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-b370f70d-d84b-4c19-a574-0c5077651554 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661062780f5c45d180a05e402fc7bc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277fa3c89dff47b88894b781ff69fb70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:15.340868 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-b370f70d-d84b-4c19-a574-0c5077651554 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/ba68561c-87aa-4ad8-a50c-de2cd1e938e2" status: 200 len: 1453 microversion: 2.1 time: 0.153855 Jul 05 13:05:15.341433 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 286/579] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:05:15 2022] GET /compute/v2.1/servers/ba68561c-87aa-4ad8-a50c-de2cd1e938e2 => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:05:15.753472 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-66d621b2-14d3-4eb7-9225-00d666cf14ca tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:15.754084 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-66d621b2-14d3-4eb7-9225-00d666cf14ca tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] [instance: fa513f2e-6870-4880-b3bf-d4f31e6d0156] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:15.760074 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-66d621b2-14d3-4eb7-9225-00d666cf14ca tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:15.760518 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-66d621b2-14d3-4eb7-9225-00d666cf14ca tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:15.761317 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-66d621b2-14d3-4eb7-9225-00d666cf14ca tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:15.761753 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-66d621b2-14d3-4eb7-9225-00d666cf14ca tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:15.835377 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-66d621b2-14d3-4eb7-9225-00d666cf14ca tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a316766a5e5e490189884369d59c74d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85af5c12238140c4a6334d9b3256f664', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:15.843333 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-66d621b2-14d3-4eb7-9225-00d666cf14ca tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] 10.222.0.36 "GET /compute/v2.1/servers/fa513f2e-6870-4880-b3bf-d4f31e6d0156" status: 200 len: 1267 microversion: 2.1 time: 0.094384 Jul 05 13:05:15.843892 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 294/580] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:05:15 2022] GET /compute/v2.1/servers/fa513f2e-6870-4880-b3bf-d4f31e6d0156 => generated 1267 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:05:15.977395 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-1b1e9423-f609-4516-889c-5888c33cdde2 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:05:15.978724 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-1b1e9423-f609-4516-889c-5888c33cdde2 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 7b7f15b2-a00e-4172-983d-f2a80401953b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:15.992970 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1b1e9423-f609-4516-889c-5888c33cdde2 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:15.992970 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1b1e9423-f609-4516-889c-5888c33cdde2 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:15.992970 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1b1e9423-f609-4516-889c-5888c33cdde2 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:15.992970 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1b1e9423-f609-4516-889c-5888c33cdde2 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:16.015716 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.objects.instance [None req-1b1e9423-f609-4516-889c-5888c33cdde2 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lazy-loading 'flavor' on Instance uuid 7b7f15b2-a00e-4172-983d-f2a80401953b {{(pid=118387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 13:05:16.412163 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-1b1e9423-f609-4516-889c-5888c33cdde2 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "POST /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b/action" status: 200 len: 32 microversion: 2.1 time: 0.439318 Jul 05 13:05:16.413290 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 287/581] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Jul 5 13:05:15 2022] POST /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b/action => generated 32 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 05 13:05:16.421993 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-a75cd2c5-b8a7-493e-b224-3adef439525d tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:16.422610 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-a75cd2c5-b8a7-493e-b224-3adef439525d tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 7b7f15b2-a00e-4172-983d-f2a80401953b] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:16.429625 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a75cd2c5-b8a7-493e-b224-3adef439525d tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:16.430073 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a75cd2c5-b8a7-493e-b224-3adef439525d tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:16.430854 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a75cd2c5-b8a7-493e-b224-3adef439525d tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:16.431287 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a75cd2c5-b8a7-493e-b224-3adef439525d tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:16.435845 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_cell1:SELECT=100 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:05:16.666177 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-a75cd2c5-b8a7-493e-b224-3adef439525d tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:16.675028 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-a75cd2c5-b8a7-493e-b224-3adef439525d tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b" status: 200 len: 1735 microversion: 2.1 time: 0.257049 Jul 05 13:05:16.675589 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 295/582] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:05:16 2022] GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b => generated 1735 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:05:16.862605 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-0460ef45-970c-4911-b926-94e982694247 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:16.863304 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-0460ef45-970c-4911-b926-94e982694247 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] [instance: fa513f2e-6870-4880-b3bf-d4f31e6d0156] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:16.870175 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0460ef45-970c-4911-b926-94e982694247 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:16.870627 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0460ef45-970c-4911-b926-94e982694247 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:16.871405 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0460ef45-970c-4911-b926-94e982694247 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:16.871833 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0460ef45-970c-4911-b926-94e982694247 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:16.947026 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-0460ef45-970c-4911-b926-94e982694247 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a316766a5e5e490189884369d59c74d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85af5c12238140c4a6334d9b3256f664', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:16.956533 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-0460ef45-970c-4911-b926-94e982694247 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] 10.222.0.36 "GET /compute/v2.1/servers/fa513f2e-6870-4880-b3bf-d4f31e6d0156" status: 200 len: 1273 microversion: 2.1 time: 0.098712 Jul 05 13:05:16.966160 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 288/583] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:05:16 2022] GET /compute/v2.1/servers/fa513f2e-6870-4880-b3bf-d4f31e6d0156 => generated 1273 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:05:17.693585 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-56f4321a-78c9-4a1c-a221-1151fa9393fe tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:17.694129 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-56f4321a-78c9-4a1c-a221-1151fa9393fe tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 7b7f15b2-a00e-4172-983d-f2a80401953b] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:17.708217 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-56f4321a-78c9-4a1c-a221-1151fa9393fe tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:17.708811 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-56f4321a-78c9-4a1c-a221-1151fa9393fe tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:17.709641 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-56f4321a-78c9-4a1c-a221-1151fa9393fe tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:17.710079 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-56f4321a-78c9-4a1c-a221-1151fa9393fe tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:17.943125 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-56f4321a-78c9-4a1c-a221-1151fa9393fe tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:17.951526 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-56f4321a-78c9-4a1c-a221-1151fa9393fe tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b" status: 200 len: 1735 microversion: 2.1 time: 0.262582 Jul 05 13:05:17.952482 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 296/584] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:05:17 2022] GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b => generated 1735 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:05:17.974152 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-e80a7fb7-5b20-4f86-b80d-be8100b8ceef tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:17.977273 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-e80a7fb7-5b20-4f86-b80d-be8100b8ceef tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] [instance: fa513f2e-6870-4880-b3bf-d4f31e6d0156] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:17.987034 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e80a7fb7-5b20-4f86-b80d-be8100b8ceef tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:17.987959 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e80a7fb7-5b20-4f86-b80d-be8100b8ceef tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:17.989350 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e80a7fb7-5b20-4f86-b80d-be8100b8ceef tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:17.990294 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e80a7fb7-5b20-4f86-b80d-be8100b8ceef tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:18.133246 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [req-8d8b5271-99e3-4f9a-8eee-f00ce936bef0 req-6ee96101-7e14-4e19-b95a-e1a9c85b76c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba68561c-87aa-4ad8-a50c-de2cd1e938e2", "tag": "6ed74edc-a183-4968-acd8-ac4783a16025"}]} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:05:18.141942 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-8d8b5271-99e3-4f9a-8eee-f00ce936bef0 req-6ee96101-7e14-4e19-b95a-e1a9c85b76c2 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:18.143385 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-8d8b5271-99e3-4f9a-8eee-f00ce936bef0 req-6ee96101-7e14-4e19-b95a-e1a9c85b76c2 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:18.157953 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.compute.server_external_events [req-8d8b5271-99e3-4f9a-8eee-f00ce936bef0 req-6ee96101-7e14-4e19-b95a-e1a9c85b76c2 service nova] Creating event network-changed:6ed74edc-a183-4968-acd8-ac4783a16025 for instance ba68561c-87aa-4ad8-a50c-de2cd1e938e2 on hv-cinder-79760 Jul 05 13:05:18.163940 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [req-8d8b5271-99e3-4f9a-8eee-f00ce936bef0 req-6ee96101-7e14-4e19-b95a-e1a9c85b76c2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034358 Jul 05 13:05:18.165762 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 297/585] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:05:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 13:05:18.199375 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-e80a7fb7-5b20-4f86-b80d-be8100b8ceef tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a316766a5e5e490189884369d59c74d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85af5c12238140c4a6334d9b3256f664', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:18.207823 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-e80a7fb7-5b20-4f86-b80d-be8100b8ceef tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] 10.222.0.36 "GET /compute/v2.1/servers/fa513f2e-6870-4880-b3bf-d4f31e6d0156" status: 200 len: 1315 microversion: 2.1 time: 0.237847 Jul 05 13:05:18.208335 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 289/586] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:05:17 2022] GET /compute/v2.1/servers/fa513f2e-6870-4880-b3bf-d4f31e6d0156 => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:05:18.965785 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [req-ff60f9b0-575a-4b32-90bf-5acd0bb5a3d9 req-89a9ced2-f169-44d9-ab90-d06f85dc9dff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa513f2e-6870-4880-b3bf-d4f31e6d0156", "tag": "5e9854dc-51db-40e4-879c-710b4640d38e"}]} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:05:18.975032 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-b4feab76-3e05-4d03-b130-f287abee13de tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:18.976656 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-b4feab76-3e05-4d03-b130-f287abee13de tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 7b7f15b2-a00e-4172-983d-f2a80401953b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:18.996399 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b4feab76-3e05-4d03-b130-f287abee13de tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:18.996867 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b4feab76-3e05-4d03-b130-f287abee13de tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:18.997642 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b4feab76-3e05-4d03-b130-f287abee13de tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:18.998074 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b4feab76-3e05-4d03-b130-f287abee13de tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:19.009929 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-ff60f9b0-575a-4b32-90bf-5acd0bb5a3d9 req-89a9ced2-f169-44d9-ab90-d06f85dc9dff service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:19.010356 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-ff60f9b0-575a-4b32-90bf-5acd0bb5a3d9 req-89a9ced2-f169-44d9-ab90-d06f85dc9dff service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:19.035106 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.compute.server_external_events [req-ff60f9b0-575a-4b32-90bf-5acd0bb5a3d9 req-89a9ced2-f169-44d9-ab90-d06f85dc9dff service nova] Creating event network-changed:5e9854dc-51db-40e4-879c-710b4640d38e for instance fa513f2e-6870-4880-b3bf-d4f31e6d0156 on hv-cinder-79760 Jul 05 13:05:19.035106 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [req-ff60f9b0-575a-4b32-90bf-5acd0bb5a3d9 req-89a9ced2-f169-44d9-ab90-d06f85dc9dff service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071588 Jul 05 13:05:19.035106 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 298/587] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:05:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:05:19.190560 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-b4feab76-3e05-4d03-b130-f287abee13de tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:19.198959 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-b4feab76-3e05-4d03-b130-f287abee13de tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b" status: 200 len: 1735 microversion: 2.1 time: 0.228611 Jul 05 13:05:19.199681 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 290/588] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:05:18 2022] GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b => generated 1735 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:05:19.225144 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-44aee8f3-38f2-4e4b-bb16-b01624c49476 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:19.225839 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-44aee8f3-38f2-4e4b-bb16-b01624c49476 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] [instance: fa513f2e-6870-4880-b3bf-d4f31e6d0156] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:19.232400 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-44aee8f3-38f2-4e4b-bb16-b01624c49476 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:19.232882 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-44aee8f3-38f2-4e4b-bb16-b01624c49476 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:19.233669 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-44aee8f3-38f2-4e4b-bb16-b01624c49476 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:19.234213 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-44aee8f3-38f2-4e4b-bb16-b01624c49476 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:19.384159 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-44aee8f3-38f2-4e4b-bb16-b01624c49476 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a316766a5e5e490189884369d59c74d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85af5c12238140c4a6334d9b3256f664', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:19.391732 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-44aee8f3-38f2-4e4b-bb16-b01624c49476 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] 10.222.0.36 "GET /compute/v2.1/servers/fa513f2e-6870-4880-b3bf-d4f31e6d0156" status: 200 len: 1315 microversion: 2.1 time: 0.170786 Jul 05 13:05:19.392379 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 299/589] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:05:19 2022] GET /compute/v2.1/servers/fa513f2e-6870-4880-b3bf-d4f31e6d0156 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:05:20.217027 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-cdd001b6-1c07-4a37-8a30-8272a6d3d54e tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:20.217618 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-cdd001b6-1c07-4a37-8a30-8272a6d3d54e tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 7b7f15b2-a00e-4172-983d-f2a80401953b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:20.224683 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cdd001b6-1c07-4a37-8a30-8272a6d3d54e tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:20.225125 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cdd001b6-1c07-4a37-8a30-8272a6d3d54e tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:20.225878 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cdd001b6-1c07-4a37-8a30-8272a6d3d54e tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:20.226313 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cdd001b6-1c07-4a37-8a30-8272a6d3d54e tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:20.357608 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-cdd001b6-1c07-4a37-8a30-8272a6d3d54e tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:20.365561 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-cdd001b6-1c07-4a37-8a30-8272a6d3d54e tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b" status: 200 len: 1735 microversion: 2.1 time: 0.152407 Jul 05 13:05:20.366128 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 291/590] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:05:20 2022] GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:05:20.408447 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-a7d8d059-9e4d-4040-88fc-8fd2b94a5d78 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:20.409025 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-a7d8d059-9e4d-4040-88fc-8fd2b94a5d78 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] [instance: fa513f2e-6870-4880-b3bf-d4f31e6d0156] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:20.415013 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a7d8d059-9e4d-4040-88fc-8fd2b94a5d78 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:20.415469 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a7d8d059-9e4d-4040-88fc-8fd2b94a5d78 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:20.416224 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a7d8d059-9e4d-4040-88fc-8fd2b94a5d78 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:20.416690 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a7d8d059-9e4d-4040-88fc-8fd2b94a5d78 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:20.542587 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-a7d8d059-9e4d-4040-88fc-8fd2b94a5d78 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a316766a5e5e490189884369d59c74d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85af5c12238140c4a6334d9b3256f664', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:20.549902 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-a7d8d059-9e4d-4040-88fc-8fd2b94a5d78 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] 10.222.0.36 "GET /compute/v2.1/servers/fa513f2e-6870-4880-b3bf-d4f31e6d0156" status: 200 len: 1315 microversion: 2.1 time: 0.145284 Jul 05 13:05:20.550455 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 300/591] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:05:20 2022] GET /compute/v2.1/servers/fa513f2e-6870-4880-b3bf-d4f31e6d0156 => generated 1315 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:05:21.383295 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-922594f3-dbe3-4805-b30d-6c2437ffff44 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:21.383914 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-922594f3-dbe3-4805-b30d-6c2437ffff44 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 7b7f15b2-a00e-4172-983d-f2a80401953b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:21.386369 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:05:21.391078 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-922594f3-dbe3-4805-b30d-6c2437ffff44 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:21.391528 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-922594f3-dbe3-4805-b30d-6c2437ffff44 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:21.392287 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-922594f3-dbe3-4805-b30d-6c2437ffff44 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:21.392759 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-922594f3-dbe3-4805-b30d-6c2437ffff44 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:21.522147 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-922594f3-dbe3-4805-b30d-6c2437ffff44 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:21.530122 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-922594f3-dbe3-4805-b30d-6c2437ffff44 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b" status: 200 len: 1735 microversion: 2.1 time: 0.150648 Jul 05 13:05:21.530687 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 292/592] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:05:21 2022] GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:05:21.567319 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-ba4f2901-5a53-4ce6-a39a-1664ad26e71d tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:21.567921 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-ba4f2901-5a53-4ce6-a39a-1664ad26e71d tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] [instance: fa513f2e-6870-4880-b3bf-d4f31e6d0156] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:21.573876 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ba4f2901-5a53-4ce6-a39a-1664ad26e71d tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:21.574315 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ba4f2901-5a53-4ce6-a39a-1664ad26e71d tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:21.575059 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ba4f2901-5a53-4ce6-a39a-1664ad26e71d tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:21.575487 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ba4f2901-5a53-4ce6-a39a-1664ad26e71d tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:21.621880 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-4706b29a-59df-4bcb-8486-8f5f84c6b8e3 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:21.622371 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-4706b29a-59df-4bcb-8486-8f5f84c6b8e3 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:21.628290 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4706b29a-59df-4bcb-8486-8f5f84c6b8e3 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:21.629269 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4706b29a-59df-4bcb-8486-8f5f84c6b8e3 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:21.630023 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4706b29a-59df-4bcb-8486-8f5f84c6b8e3 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:21.630454 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4706b29a-59df-4bcb-8486-8f5f84c6b8e3 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:21.643730 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:05:21.661775 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-4706b29a-59df-4bcb-8486-8f5f84c6b8e3 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f/os-volume_attachments/2b46f9b1-8f44-45c1-9fa3-dedee47c1247" status: 200 len: 194 microversion: 2.20 time: 0.040828 Jul 05 13:05:21.661775 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 293/593] 10.222.0.36 () {60 vars in 1453 bytes} [Tue Jul 5 13:05:21 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f/os-volume_attachments/2b46f9b1-8f44-45c1-9fa3-dedee47c1247 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 05 13:05:21.703123 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-ba4f2901-5a53-4ce6-a39a-1664ad26e71d tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a316766a5e5e490189884369d59c74d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85af5c12238140c4a6334d9b3256f664', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:21.711616 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-ba4f2901-5a53-4ce6-a39a-1664ad26e71d tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] 10.222.0.36 "GET /compute/v2.1/servers/fa513f2e-6870-4880-b3bf-d4f31e6d0156" status: 200 len: 1315 microversion: 2.1 time: 0.148636 Jul 05 13:05:21.712161 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 301/594] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:05:21 2022] GET /compute/v2.1/servers/fa513f2e-6870-4880-b3bf-d4f31e6d0156 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:05:21.724019 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-afd9c409-f8ab-40a5-b34e-0f07b1b11e8c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:21.724516 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-afd9c409-f8ab-40a5-b34e-0f07b1b11e8c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:21.731207 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-afd9c409-f8ab-40a5-b34e-0f07b1b11e8c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:21.731656 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-afd9c409-f8ab-40a5-b34e-0f07b1b11e8c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:21.732423 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-afd9c409-f8ab-40a5-b34e-0f07b1b11e8c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:21.732903 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-afd9c409-f8ab-40a5-b34e-0f07b1b11e8c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:21.811842 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.objects.instance [None req-afd9c409-f8ab-40a5-b34e-0f07b1b11e8c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lazy-loading 'services' on Instance uuid 72285b0b-7735-422b-b110-ef7b03fb367f {{(pid=118387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 13:05:22.017888 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-afd9c409-f8ab-40a5-b34e-0f07b1b11e8c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "DELETE /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f/os-volume_attachments/2b46f9b1-8f44-45c1-9fa3-dedee47c1247" status: 202 len: 0 microversion: 2.20 time: 0.297952 Jul 05 13:05:22.018477 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 294/595] 10.222.0.36 () {60 vars in 1456 bytes} [Tue Jul 5 13:05:21 2022] DELETE /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f/os-volume_attachments/2b46f9b1-8f44-45c1-9fa3-dedee47c1247 => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 05 13:05:22.027660 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-ccf07a78-53dc-4361-8583-5b092abaad5f tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:22.028650 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-ccf07a78-53dc-4361-8583-5b092abaad5f tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:22.034639 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ccf07a78-53dc-4361-8583-5b092abaad5f tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:22.035053 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ccf07a78-53dc-4361-8583-5b092abaad5f tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:22.035802 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ccf07a78-53dc-4361-8583-5b092abaad5f tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:22.036226 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ccf07a78-53dc-4361-8583-5b092abaad5f tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:22.065190 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-ccf07a78-53dc-4361-8583-5b092abaad5f tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041593 Jul 05 13:05:22.066431 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 302/596] 10.222.0.36 () {60 vars in 1342 bytes} [Tue Jul 5 13:05:22 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 05 13:05:22.548285 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-1ab11945-0134-4c72-bd6e-8fe7dbe037bc tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:22.549001 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-1ab11945-0134-4c72-bd6e-8fe7dbe037bc tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 7b7f15b2-a00e-4172-983d-f2a80401953b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:22.555697 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1ab11945-0134-4c72-bd6e-8fe7dbe037bc tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:22.556147 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1ab11945-0134-4c72-bd6e-8fe7dbe037bc tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:22.556945 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1ab11945-0134-4c72-bd6e-8fe7dbe037bc tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:22.557378 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1ab11945-0134-4c72-bd6e-8fe7dbe037bc tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:22.687429 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-1ab11945-0134-4c72-bd6e-8fe7dbe037bc tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:22.695327 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-1ab11945-0134-4c72-bd6e-8fe7dbe037bc tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b" status: 200 len: 1735 microversion: 2.1 time: 0.151738 Jul 05 13:05:22.695893 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 295/597] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:05:22 2022] GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:05:22.728750 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-4a164920-698f-48aa-bf21-7a4648c24ba8 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:22.729369 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-4a164920-698f-48aa-bf21-7a4648c24ba8 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] [instance: fa513f2e-6870-4880-b3bf-d4f31e6d0156] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:22.735345 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-4a164920-698f-48aa-bf21-7a4648c24ba8 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:22.735786 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-4a164920-698f-48aa-bf21-7a4648c24ba8 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:22.736532 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-4a164920-698f-48aa-bf21-7a4648c24ba8 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:22.736987 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-4a164920-698f-48aa-bf21-7a4648c24ba8 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:22.877854 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-4a164920-698f-48aa-bf21-7a4648c24ba8 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a316766a5e5e490189884369d59c74d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85af5c12238140c4a6334d9b3256f664', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:22.885535 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-4a164920-698f-48aa-bf21-7a4648c24ba8 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] 10.222.0.36 "GET /compute/v2.1/servers/fa513f2e-6870-4880-b3bf-d4f31e6d0156" status: 200 len: 1315 microversion: 2.1 time: 0.160699 Jul 05 13:05:22.885916 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 303/598] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:05:22 2022] GET /compute/v2.1/servers/fa513f2e-6870-4880-b3bf-d4f31e6d0156 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:05:23.077457 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-8b01e2a4-aadd-46de-ae1e-1656da01ffe3 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:23.078367 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-8b01e2a4-aadd-46de-ae1e-1656da01ffe3 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:23.086990 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8b01e2a4-aadd-46de-ae1e-1656da01ffe3 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:23.087443 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8b01e2a4-aadd-46de-ae1e-1656da01ffe3 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:23.088876 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8b01e2a4-aadd-46de-ae1e-1656da01ffe3 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:23.089402 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8b01e2a4-aadd-46de-ae1e-1656da01ffe3 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:23.122955 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-8b01e2a4-aadd-46de-ae1e-1656da01ffe3 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049412 Jul 05 13:05:23.123617 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 296/599] 10.222.0.36 () {60 vars in 1342 bytes} [Tue Jul 5 13:05:23 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 13:05:23.713122 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-f392e91d-df39-4056-8f93-4b5cc188cb70 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:23.713782 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-f392e91d-df39-4056-8f93-4b5cc188cb70 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 7b7f15b2-a00e-4172-983d-f2a80401953b] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:23.715749 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_cell0:SELECT=2 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:05:23.720553 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f392e91d-df39-4056-8f93-4b5cc188cb70 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:23.721920 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f392e91d-df39-4056-8f93-4b5cc188cb70 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:23.723096 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f392e91d-df39-4056-8f93-4b5cc188cb70 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:23.723528 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f392e91d-df39-4056-8f93-4b5cc188cb70 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:23.851797 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-f392e91d-df39-4056-8f93-4b5cc188cb70 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:23.860068 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-f392e91d-df39-4056-8f93-4b5cc188cb70 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b" status: 200 len: 1735 microversion: 2.1 time: 0.150826 Jul 05 13:05:23.860647 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 304/600] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:05:23 2022] GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:05:23.903038 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-b1885163-8995-44d8-a45c-6c866e1afbfc tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:23.903641 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-b1885163-8995-44d8-a45c-6c866e1afbfc tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] [instance: fa513f2e-6870-4880-b3bf-d4f31e6d0156] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:23.905632 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell0:SELECT=2 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:05:23.910969 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b1885163-8995-44d8-a45c-6c866e1afbfc tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:23.911417 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b1885163-8995-44d8-a45c-6c866e1afbfc tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:23.912194 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b1885163-8995-44d8-a45c-6c866e1afbfc tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:23.912646 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b1885163-8995-44d8-a45c-6c866e1afbfc tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:24.044940 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-b1885163-8995-44d8-a45c-6c866e1afbfc tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a316766a5e5e490189884369d59c74d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85af5c12238140c4a6334d9b3256f664', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:24.052508 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-b1885163-8995-44d8-a45c-6c866e1afbfc tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] 10.222.0.36 "GET /compute/v2.1/servers/fa513f2e-6870-4880-b3bf-d4f31e6d0156" status: 200 len: 1315 microversion: 2.1 time: 0.153198 Jul 05 13:05:24.053059 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 297/601] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:05:23 2022] GET /compute/v2.1/servers/fa513f2e-6870-4880-b3bf-d4f31e6d0156 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:05:24.135453 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-8f45fc9a-4e67-4070-8631-6d539fef1f2c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:24.136360 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-8f45fc9a-4e67-4070-8631-6d539fef1f2c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:24.142558 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-8f45fc9a-4e67-4070-8631-6d539fef1f2c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:24.143009 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-8f45fc9a-4e67-4070-8631-6d539fef1f2c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:24.143776 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-8f45fc9a-4e67-4070-8631-6d539fef1f2c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:24.144208 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-8f45fc9a-4e67-4070-8631-6d539fef1f2c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:24.177808 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-8f45fc9a-4e67-4070-8631-6d539fef1f2c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046231 Jul 05 13:05:24.178393 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 305/602] 10.222.0.36 () {60 vars in 1342 bytes} [Tue Jul 5 13:05:24 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:05:24.234705 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-4f9092c1-8d0f-4ca1-9b5e-db22761ce2ee tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:24.235200 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-4f9092c1-8d0f-4ca1-9b5e-db22761ce2ee tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:24.241461 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4f9092c1-8d0f-4ca1-9b5e-db22761ce2ee tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:24.241901 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4f9092c1-8d0f-4ca1-9b5e-db22761ce2ee tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:24.242650 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4f9092c1-8d0f-4ca1-9b5e-db22761ce2ee tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:24.243073 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4f9092c1-8d0f-4ca1-9b5e-db22761ce2ee tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:24.267982 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-4f9092c1-8d0f-4ca1-9b5e-db22761ce2ee tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Going to try to terminate instance {{(pid=118387) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 13:05:24.557042 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-4f9092c1-8d0f-4ca1-9b5e-db22761ce2ee tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "DELETE /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 204 len: 0 microversion: 2.20 time: 0.325784 Jul 05 13:05:24.557632 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 298/603] 10.222.0.36 () {60 vars in 1279 bytes} [Tue Jul 5 13:05:24 2022] DELETE /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 05 13:05:24.572764 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-d91e1426-96cc-4ede-961b-9408970ba7ef tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:24.573367 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-d91e1426-96cc-4ede-961b-9408970ba7ef tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:24.579261 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-d91e1426-96cc-4ede-961b-9408970ba7ef tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:24.579695 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-d91e1426-96cc-4ede-961b-9408970ba7ef tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:24.580436 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-d91e1426-96cc-4ede-961b-9408970ba7ef tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:24.580883 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-d91e1426-96cc-4ede-961b-9408970ba7ef tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:24.708198 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-d91e1426-96cc-4ede-961b-9408970ba7ef tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:24.716075 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-d91e1426-96cc-4ede-961b-9408970ba7ef tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:24.717577 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-d91e1426-96cc-4ede-961b-9408970ba7ef tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:24.718709 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-d91e1426-96cc-4ede-961b-9408970ba7ef tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1724 microversion: 2.20 time: 0.149872 Jul 05 13:05:24.719251 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 306/604] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:05:24 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:05:24.878545 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-5ba88f46-ce71-4e69-9e2e-1a34aa068125 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:24.879246 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-5ba88f46-ce71-4e69-9e2e-1a34aa068125 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 7b7f15b2-a00e-4172-983d-f2a80401953b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:24.881238 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell0:SELECT=8 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:05:24.886000 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5ba88f46-ce71-4e69-9e2e-1a34aa068125 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:24.890200 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5ba88f46-ce71-4e69-9e2e-1a34aa068125 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:24.890200 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5ba88f46-ce71-4e69-9e2e-1a34aa068125 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:24.890200 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5ba88f46-ce71-4e69-9e2e-1a34aa068125 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:25.017641 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-5ba88f46-ce71-4e69-9e2e-1a34aa068125 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:25.025897 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-5ba88f46-ce71-4e69-9e2e-1a34aa068125 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b" status: 200 len: 1735 microversion: 2.1 time: 0.151549 Jul 05 13:05:25.026680 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 299/605] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:05:24 2022] GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:05:25.069229 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-f98e04ff-d0ff-4f1d-bfc9-8e5a4db1eaf7 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:25.069932 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-f98e04ff-d0ff-4f1d-bfc9-8e5a4db1eaf7 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] [instance: fa513f2e-6870-4880-b3bf-d4f31e6d0156] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:25.075887 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f98e04ff-d0ff-4f1d-bfc9-8e5a4db1eaf7 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:25.076332 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f98e04ff-d0ff-4f1d-bfc9-8e5a4db1eaf7 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:25.077114 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f98e04ff-d0ff-4f1d-bfc9-8e5a4db1eaf7 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:25.077570 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f98e04ff-d0ff-4f1d-bfc9-8e5a4db1eaf7 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:25.103711 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-653d26da-145f-4c0f-b67f-68f6721dda1f req-80af6b07-64e5-4e74-9dd0-8b969fcd362a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa513f2e-6870-4880-b3bf-d4f31e6d0156", "name": "network-vif-plugged", "status": "completed", "tag": "5e9854dc-51db-40e4-879c-710b4640d38e"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:05:25.113140 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-653d26da-145f-4c0f-b67f-68f6721dda1f req-80af6b07-64e5-4e74-9dd0-8b969fcd362a service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:25.113679 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-653d26da-145f-4c0f-b67f-68f6721dda1f req-80af6b07-64e5-4e74-9dd0-8b969fcd362a service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:25.124960 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-653d26da-145f-4c0f-b67f-68f6721dda1f req-80af6b07-64e5-4e74-9dd0-8b969fcd362a service nova] Creating event network-vif-plugged:5e9854dc-51db-40e4-879c-710b4640d38e for instance fa513f2e-6870-4880-b3bf-d4f31e6d0156 on hv-cinder-79760 Jul 05 13:05:25.129828 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-653d26da-145f-4c0f-b67f-68f6721dda1f req-80af6b07-64e5-4e74-9dd0-8b969fcd362a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030207 Jul 05 13:05:25.130496 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 300/606] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:05:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 13:05:25.209604 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-f98e04ff-d0ff-4f1d-bfc9-8e5a4db1eaf7 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a316766a5e5e490189884369d59c74d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85af5c12238140c4a6334d9b3256f664', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:25.220879 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-f98e04ff-d0ff-4f1d-bfc9-8e5a4db1eaf7 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] 10.222.0.36 "GET /compute/v2.1/servers/fa513f2e-6870-4880-b3bf-d4f31e6d0156" status: 200 len: 1315 microversion: 2.1 time: 0.151533 Jul 05 13:05:25.220879 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 307/607] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:05:25 2022] GET /compute/v2.1/servers/fa513f2e-6870-4880-b3bf-d4f31e6d0156 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:05:25.739162 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-28bf8df9-0af0-42e0-8cf1-3b348b37d86e tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:25.739881 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-28bf8df9-0af0-42e0-8cf1-3b348b37d86e tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:25.746076 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-28bf8df9-0af0-42e0-8cf1-3b348b37d86e tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:25.746523 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-28bf8df9-0af0-42e0-8cf1-3b348b37d86e tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:25.747280 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-28bf8df9-0af0-42e0-8cf1-3b348b37d86e tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:25.747714 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-28bf8df9-0af0-42e0-8cf1-3b348b37d86e tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:25.874557 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-28bf8df9-0af0-42e0-8cf1-3b348b37d86e tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:25.882891 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-28bf8df9-0af0-42e0-8cf1-3b348b37d86e tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:25.884389 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-28bf8df9-0af0-42e0-8cf1-3b348b37d86e tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:25.885625 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-28bf8df9-0af0-42e0-8cf1-3b348b37d86e tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1724 microversion: 2.20 time: 0.151826 Jul 05 13:05:25.886129 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 301/608] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:05:25 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:05:26.043041 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-0253e1e0-e61a-451e-937d-4ded69c49e37 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:26.043754 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-0253e1e0-e61a-451e-937d-4ded69c49e37 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 7b7f15b2-a00e-4172-983d-f2a80401953b] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:26.049729 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-0253e1e0-e61a-451e-937d-4ded69c49e37 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:26.050963 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-0253e1e0-e61a-451e-937d-4ded69c49e37 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:26.051896 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-0253e1e0-e61a-451e-937d-4ded69c49e37 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:26.052337 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-0253e1e0-e61a-451e-937d-4ded69c49e37 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:26.188470 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-0253e1e0-e61a-451e-937d-4ded69c49e37 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:26.197074 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-0253e1e0-e61a-451e-937d-4ded69c49e37 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b" status: 200 len: 1735 microversion: 2.1 time: 0.157812 Jul 05 13:05:26.197630 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 308/609] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:05:26 2022] GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:05:26.234555 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-4f5e1c85-b37f-45c1-9da1-7c7bcf11cc11 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:26.235208 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-4f5e1c85-b37f-45c1-9da1-7c7bcf11cc11 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] [instance: fa513f2e-6870-4880-b3bf-d4f31e6d0156] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:26.242350 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4f5e1c85-b37f-45c1-9da1-7c7bcf11cc11 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:26.242803 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4f5e1c85-b37f-45c1-9da1-7c7bcf11cc11 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:26.243572 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4f5e1c85-b37f-45c1-9da1-7c7bcf11cc11 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:26.244008 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4f5e1c85-b37f-45c1-9da1-7c7bcf11cc11 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:26.376811 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-4f5e1c85-b37f-45c1-9da1-7c7bcf11cc11 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a316766a5e5e490189884369d59c74d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85af5c12238140c4a6334d9b3256f664', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:26.384152 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-4f5e1c85-b37f-45c1-9da1-7c7bcf11cc11 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] 10.222.0.36 "GET /compute/v2.1/servers/fa513f2e-6870-4880-b3bf-d4f31e6d0156" status: 200 len: 1315 microversion: 2.1 time: 0.153409 Jul 05 13:05:26.384788 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 302/610] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:05:26 2022] GET /compute/v2.1/servers/fa513f2e-6870-4880-b3bf-d4f31e6d0156 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:05:26.903319 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-b24238e7-a076-4d65-a154-3059ef1df830 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:26.903854 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-b24238e7-a076-4d65-a154-3059ef1df830 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:26.910382 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b24238e7-a076-4d65-a154-3059ef1df830 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:26.910817 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b24238e7-a076-4d65-a154-3059ef1df830 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:26.911569 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b24238e7-a076-4d65-a154-3059ef1df830 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:26.911992 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b24238e7-a076-4d65-a154-3059ef1df830 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:27.043374 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-b24238e7-a076-4d65-a154-3059ef1df830 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:27.051933 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-b24238e7-a076-4d65-a154-3059ef1df830 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:27.053448 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-b24238e7-a076-4d65-a154-3059ef1df830 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:27.054592 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-b24238e7-a076-4d65-a154-3059ef1df830 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1724 microversion: 2.20 time: 0.155254 Jul 05 13:05:27.055145 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 309/611] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:05:26 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:05:27.214333 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-e2d534ed-a838-4fb2-87ca-951f1c4488be tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:27.214932 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-e2d534ed-a838-4fb2-87ca-951f1c4488be tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 7b7f15b2-a00e-4172-983d-f2a80401953b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:27.223733 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e2d534ed-a838-4fb2-87ca-951f1c4488be tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:27.223733 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e2d534ed-a838-4fb2-87ca-951f1c4488be tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:27.224383 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e2d534ed-a838-4fb2-87ca-951f1c4488be tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:27.224925 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e2d534ed-a838-4fb2-87ca-951f1c4488be tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:27.354563 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-e2d534ed-a838-4fb2-87ca-951f1c4488be tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:27.362839 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-e2d534ed-a838-4fb2-87ca-951f1c4488be tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b" status: 200 len: 1735 microversion: 2.1 time: 0.152158 Jul 05 13:05:27.363414 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 303/612] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:05:27 2022] GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:05:27.401084 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-d37b1d12-e2e2-4a95-85f9-390369d0af0d tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:27.401742 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-d37b1d12-e2e2-4a95-85f9-390369d0af0d tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] [instance: fa513f2e-6870-4880-b3bf-d4f31e6d0156] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:27.407716 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-d37b1d12-e2e2-4a95-85f9-390369d0af0d tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:27.408168 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-d37b1d12-e2e2-4a95-85f9-390369d0af0d tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:27.408963 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-d37b1d12-e2e2-4a95-85f9-390369d0af0d tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:27.409401 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-d37b1d12-e2e2-4a95-85f9-390369d0af0d tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:27.542601 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-d37b1d12-e2e2-4a95-85f9-390369d0af0d tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a316766a5e5e490189884369d59c74d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85af5c12238140c4a6334d9b3256f664', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:27.551586 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-d37b1d12-e2e2-4a95-85f9-390369d0af0d tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] 10.222.0.36 "GET /compute/v2.1/servers/fa513f2e-6870-4880-b3bf-d4f31e6d0156" status: 200 len: 1315 microversion: 2.1 time: 0.154304 Jul 05 13:05:27.552366 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 310/613] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:05:27 2022] GET /compute/v2.1/servers/fa513f2e-6870-4880-b3bf-d4f31e6d0156 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:05:27.723894 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-2df34953-22f5-40ff-b15c-7a14508ccf94 req-51ae7f28-4cce-4b54-85a5-b4b066f6f05f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72285b0b-7735-422b-b110-ef7b03fb367f", "name": "network-vif-deleted", "tag": "caf3b4b2-126a-423d-b8ca-4680670bb511"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:05:27.732843 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-2df34953-22f5-40ff-b15c-7a14508ccf94 req-51ae7f28-4cce-4b54-85a5-b4b066f6f05f service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:27.733282 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-2df34953-22f5-40ff-b15c-7a14508ccf94 req-51ae7f28-4cce-4b54-85a5-b4b066f6f05f service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:27.745835 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-2df34953-22f5-40ff-b15c-7a14508ccf94 req-51ae7f28-4cce-4b54-85a5-b4b066f6f05f service nova] Creating event network-vif-deleted:caf3b4b2-126a-423d-b8ca-4680670bb511 for instance 72285b0b-7735-422b-b110-ef7b03fb367f on hv-cinder-79760 Jul 05 13:05:27.750872 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-2df34953-22f5-40ff-b15c-7a14508ccf94 req-51ae7f28-4cce-4b54-85a5-b4b066f6f05f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030528 Jul 05 13:05:27.751473 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 304/614] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:05:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:05:28.073141 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-7846e3fa-1637-46d5-9f4c-5b804aea5023 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:28.073908 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-7846e3fa-1637-46d5-9f4c-5b804aea5023 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:28.080012 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-7846e3fa-1637-46d5-9f4c-5b804aea5023 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:28.080466 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-7846e3fa-1637-46d5-9f4c-5b804aea5023 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:28.081254 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-7846e3fa-1637-46d5-9f4c-5b804aea5023 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:28.081690 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-7846e3fa-1637-46d5-9f4c-5b804aea5023 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:28.148871 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-7846e3fa-1637-46d5-9f4c-5b804aea5023 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:28.157414 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-7846e3fa-1637-46d5-9f4c-5b804aea5023 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:28.159015 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-7846e3fa-1637-46d5-9f4c-5b804aea5023 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:28.161127 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-7846e3fa-1637-46d5-9f4c-5b804aea5023 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 200 len: 1657 microversion: 2.20 time: 0.091867 Jul 05 13:05:28.161753 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 311/615] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:05:28 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 1657 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:05:28.381506 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-f3896465-1bde-4b19-a6dc-b58be5c30294 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:28.382242 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-f3896465-1bde-4b19-a6dc-b58be5c30294 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 7b7f15b2-a00e-4172-983d-f2a80401953b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:28.388492 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f3896465-1bde-4b19-a6dc-b58be5c30294 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:28.388978 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f3896465-1bde-4b19-a6dc-b58be5c30294 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:28.389746 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f3896465-1bde-4b19-a6dc-b58be5c30294 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:28.390193 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f3896465-1bde-4b19-a6dc-b58be5c30294 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:28.536412 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-f3896465-1bde-4b19-a6dc-b58be5c30294 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:28.544805 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-f3896465-1bde-4b19-a6dc-b58be5c30294 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b" status: 200 len: 1735 microversion: 2.1 time: 0.168131 Jul 05 13:05:28.545373 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 305/616] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:05:28 2022] GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:05:28.569043 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-5a358fba-6892-4599-805d-08b6b59b51d0 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:28.573643 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-5a358fba-6892-4599-805d-08b6b59b51d0 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] [instance: fa513f2e-6870-4880-b3bf-d4f31e6d0156] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:28.576019 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-5a358fba-6892-4599-805d-08b6b59b51d0 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:28.576465 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-5a358fba-6892-4599-805d-08b6b59b51d0 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:28.577253 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-5a358fba-6892-4599-805d-08b6b59b51d0 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:28.577680 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-5a358fba-6892-4599-805d-08b6b59b51d0 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:28.711580 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-5a358fba-6892-4599-805d-08b6b59b51d0 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a316766a5e5e490189884369d59c74d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85af5c12238140c4a6334d9b3256f664', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:28.719036 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-5a358fba-6892-4599-805d-08b6b59b51d0 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] 10.222.0.36 "GET /compute/v2.1/servers/fa513f2e-6870-4880-b3bf-d4f31e6d0156" status: 200 len: 1464 microversion: 2.1 time: 0.154336 Jul 05 13:05:28.719602 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 312/617] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:05:28 2022] GET /compute/v2.1/servers/fa513f2e-6870-4880-b3bf-d4f31e6d0156 => generated 1464 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:05:28.758570 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-627afcd5-2bfd-441e-ade3-a68d5d123393 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:28.759068 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-627afcd5-2bfd-441e-ade3-a68d5d123393 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] [instance: fa513f2e-6870-4880-b3bf-d4f31e6d0156] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:28.765052 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-627afcd5-2bfd-441e-ade3-a68d5d123393 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:28.765498 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-627afcd5-2bfd-441e-ade3-a68d5d123393 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:28.766258 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-627afcd5-2bfd-441e-ade3-a68d5d123393 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:28.766688 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-627afcd5-2bfd-441e-ade3-a68d5d123393 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:28.791403 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-627afcd5-2bfd-441e-ade3-a68d5d123393 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] [instance: fa513f2e-6870-4880-b3bf-d4f31e6d0156] Going to try to terminate instance {{(pid=118387) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 13:05:29.099644 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-627afcd5-2bfd-441e-ade3-a68d5d123393 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] 10.222.0.36 "DELETE /compute/v2.1/servers/fa513f2e-6870-4880-b3bf-d4f31e6d0156" status: 204 len: 0 microversion: 2.1 time: 0.344536 Jul 05 13:05:29.100232 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 306/618] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jul 5 13:05:28 2022] DELETE /compute/v2.1/servers/fa513f2e-6870-4880-b3bf-d4f31e6d0156 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 05 13:05:29.108659 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-3a32caff-6d20-41c8-8060-2d528a64275c tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:29.109265 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-3a32caff-6d20-41c8-8060-2d528a64275c tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] [instance: fa513f2e-6870-4880-b3bf-d4f31e6d0156] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:29.115685 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-3a32caff-6d20-41c8-8060-2d528a64275c tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:29.116126 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-3a32caff-6d20-41c8-8060-2d528a64275c tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:29.116897 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-3a32caff-6d20-41c8-8060-2d528a64275c tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:29.117498 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-3a32caff-6d20-41c8-8060-2d528a64275c tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:29.121374 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_cell1:SELECT=100 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:05:29.180428 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-f5b58c98-5bbe-4fbe-a997-2d49d25f7dc6 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:29.181140 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-f5b58c98-5bbe-4fbe-a997-2d49d25f7dc6 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:29.187035 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f5b58c98-5bbe-4fbe-a997-2d49d25f7dc6 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:29.187534 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f5b58c98-5bbe-4fbe-a997-2d49d25f7dc6 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:29.188290 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f5b58c98-5bbe-4fbe-a997-2d49d25f7dc6 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:29.188747 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f5b58c98-5bbe-4fbe-a997-2d49d25f7dc6 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:29.202731 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.wsgi [None req-f5b58c98-5bbe-4fbe-a997-2d49d25f7dc6 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] HTTP exception thrown: Instance 72285b0b-7735-422b-b110-ef7b03fb367f could not be found. Jul 05 13:05:29.204370 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-f5b58c98-5bbe-4fbe-a997-2d49d25f7dc6 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Request method failure captured: Jul 05 13:05:29.204370 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: request: GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f HTTP/1.1 Jul 05 13:05:29.204370 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept: application/json Jul 05 13:05:29.204370 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept-Encoding: identity Jul 05 13:05:29.204370 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Connection: close Jul 05 13:05:29.204370 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Length: 0 Jul 05 13:05:29.204370 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Type: application/json Jul 05 13:05:29.204370 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Host: 10.222.0.36 Jul 05 13:05:29.204370 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Openstack-System-Scope: None Jul 05 13:05:29.204370 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: User-Agent: python-urllib3/1.26.9 Jul 05 13:05:29.204370 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Auth-Token: gAAAAABixDYU4XKFSG1QuYBUfrOR6esVXAvVAGSwtVHPu7LBdH9y2w_YzZETCWfsRdlNKtdKF1ZnCITRlR9D6eRFZEIctYOdEIyordTrOjyt8lpzMH7MZZMgDMWMYkmZd-zLknVG2Gu6MRGRZNFw44v144fi7JGPzg5WSXfnQTVCEpw58mz6RK4 Jul 05 13:05:29.204370 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Id: None Jul 05 13:05:29.204370 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Name: None Jul 05 13:05:29.204370 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Identity-Status: Confirmed Jul 05 13:05:29.204370 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Is-Admin-Project: True Jul 05 13:05:29.204370 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Openstack-Nova-Api-Version: 2.20 Jul 05 13:05:29.204370 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Id: default Jul 05 13:05:29.204370 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Name: Default Jul 05 13:05:29.204370 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Id: 6c201d76ac4e4cc08fdc38e7165d4764 Jul 05 13:05:29.204370 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-32891023 Jul 05 13:05:29.204370 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Role: member,reader Jul 05 13:05:29.204370 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Roles: member,reader Jul 05 13:05:29.206158 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6c201d76ac4e4cc08fdc38e7165d4764"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6c201d76ac4e4cc08fdc38e7165d4764", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6c201d76ac4e4cc08fdc38e7165d4764"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6c201d76ac4e4cc08fdc38e7165d4764"}]}] Jul 05 13:05:29.206158 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant: tempest-AttachVolumeShelveTestJSON-32891023 Jul 05 13:05:29.206158 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Id: 6c201d76ac4e4cc08fdc38e7165d4764 Jul 05 13:05:29.206158 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-32891023 Jul 05 13:05:29.206158 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User: tempest-AttachVolumeShelveTestJSON-32891023-project Jul 05 13:05:29.206158 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Id: default Jul 05 13:05:29.206158 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Name: Default Jul 05 13:05:29.206158 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Id: 475bac060a98475d858e6181eec7ce11 Jul 05 13:05:29.206158 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Name: tempest-AttachVolumeShelveTestJSON-32891023-project Jul 05 13:05:29.206158 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: method: > Jul 05 13:05:29.206158 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: exception: Instance 72285b0b-7735-422b-b110-ef7b03fb367f could not be found. Jul 05 13:05:29.206158 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: action_args: {'id': '72285b0b-7735-422b-b110-ef7b03fb367f'} Jul 05 13:05:29.207015 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 13:05:29.207015 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:05:29.207015 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 13:05:29.207015 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 13:05:29.207015 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 13:05:29.207015 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 13:05:29.207015 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 13:05:29.207015 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 13:05:29.207015 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 13:05:29.207015 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 13:05:29.207015 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72285b0b-7735-422b-b110-ef7b03fb367f could not be found. Jul 05 13:05:29.207015 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:05:29.207015 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:05:29.207015 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:05:29.207015 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:05:29.207015 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:05:29.207015 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:05:29.207015 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 13:05:29.207015 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 13:05:29.207015 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 13:05:29.208248 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 13:05:29.208248 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 13:05:29.208248 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 13:05:29.208248 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 13:05:29.208248 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 13:05:29.208248 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 13:05:29.208248 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 13:05:29.208248 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72285b0b-7735-422b-b110-ef7b03fb367f could not be found. Jul 05 13:05:29.208248 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:05:29.208248 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:05:29.208248 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:05:29.208248 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:05:29.208248 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:05:29.208248 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:05:29.208248 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 13:05:29.208248 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 13:05:29.208248 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72285b0b-7735-422b-b110-ef7b03fb367f could not be found. Jul 05 13:05:29.208248 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:05:29.209416 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-f5b58c98-5bbe-4fbe-a997-2d49d25f7dc6 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Returning 404 to user: Instance 72285b0b-7735-422b-b110-ef7b03fb367f could not be found. {{(pid=118387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 13:05:29.209416 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-f5b58c98-5bbe-4fbe-a997-2d49d25f7dc6 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 404 len: 111 microversion: 2.20 time: 0.029715 Jul 05 13:05:29.209416 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 307/619] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:05:29 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 05 13:05:29.215430 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-17731633-3df5-4f0b-90b8-457bea0244c6 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '.version_select at 0x7f70de6fe5e0>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:29.252031 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-3a32caff-6d20-41c8-8060-2d528a64275c tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a316766a5e5e490189884369d59c74d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85af5c12238140c4a6334d9b3256f664', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:29.260390 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-3a32caff-6d20-41c8-8060-2d528a64275c tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] 10.222.0.36 "GET /compute/v2.1/servers/fa513f2e-6870-4880-b3bf-d4f31e6d0156" status: 200 len: 1470 microversion: 2.1 time: 0.155508 Jul 05 13:05:29.261018 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 313/620] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:05:29 2022] GET /compute/v2.1/servers/fa513f2e-6870-4880-b3bf-d4f31e6d0156 => generated 1470 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:05:29.283799 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-17731633-3df5-4f0b-90b8-457bea0244c6 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1458947569" status: 204 len: 0 microversion: 2.20 time: 0.072023 Jul 05 13:05:29.284381 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 308/621] 10.222.0.36 () {60 vars in 1261 bytes} [Tue Jul 5 13:05:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1458947569 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 05 13:05:29.562347 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-2444d469-c50f-44d9-9d09-3bf0f7e60802 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:29.563299 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-2444d469-c50f-44d9-9d09-3bf0f7e60802 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 7b7f15b2-a00e-4172-983d-f2a80401953b] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:29.569631 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-2444d469-c50f-44d9-9d09-3bf0f7e60802 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:29.575878 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-2444d469-c50f-44d9-9d09-3bf0f7e60802 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:29.575878 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-2444d469-c50f-44d9-9d09-3bf0f7e60802 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:29.575878 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-2444d469-c50f-44d9-9d09-3bf0f7e60802 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:29.702693 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-2444d469-c50f-44d9-9d09-3bf0f7e60802 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:29.711142 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-2444d469-c50f-44d9-9d09-3bf0f7e60802 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b" status: 200 len: 1735 microversion: 2.1 time: 0.152905 Jul 05 13:05:29.711701 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 314/622] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:05:29 2022] GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:05:30.094394 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-f441a386-bc9e-47fd-8f05-aa68a5faa959 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Action: 'create', calling method: .version_select at 0x7f70de6018b0>, body: {"keypair": {"name": "tempest-keypair-547496300", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFMuGnbV4g8mvJIE5am9Do6+14zLMpOwFhu0oPnbgks7H+acOk4LNGZncbG4/lajiUvy+C7rgj6GSlwXpm3DJ/6WSpIwuRo8GZ4UCoePSPb6VmW1zK0KtB18TgpEA7D85g=="}} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:05:30.109643 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.quota [None req-f441a386-bc9e-47fd-8f05-aa68a5faa959 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Getting quotas for project 6c201d76ac4e4cc08fdc38e7165d4764. Resources: {'key_pairs'} {{(pid=118387) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 13:05:30.113391 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.quota [None req-f441a386-bc9e-47fd-8f05-aa68a5faa959 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Getting quotas for user 475bac060a98475d858e6181eec7ce11 and project 6c201d76ac4e4cc08fdc38e7165d4764. Resources: {'key_pairs'} {{(pid=118387) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 13:05:30.243116 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-f441a386-bc9e-47fd-8f05-aa68a5faa959 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.152634 Jul 05 13:05:30.243708 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 309/623] 10.222.0.36 () {62 vars in 1199 bytes} [Tue Jul 5 13:05:30 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 154 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 05 13:05:30.277677 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-ed25b528-45cc-4f7b-ba64-bffc8fc73ee3 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:30.278290 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-ed25b528-45cc-4f7b-ba64-bffc8fc73ee3 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] [instance: fa513f2e-6870-4880-b3bf-d4f31e6d0156] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:30.284278 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ed25b528-45cc-4f7b-ba64-bffc8fc73ee3 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:30.284767 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ed25b528-45cc-4f7b-ba64-bffc8fc73ee3 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:30.285526 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ed25b528-45cc-4f7b-ba64-bffc8fc73ee3 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:30.285958 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ed25b528-45cc-4f7b-ba64-bffc8fc73ee3 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:30.415496 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-ed25b528-45cc-4f7b-ba64-bffc8fc73ee3 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a316766a5e5e490189884369d59c74d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85af5c12238140c4a6334d9b3256f664', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:30.423022 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-ed25b528-45cc-4f7b-ba64-bffc8fc73ee3 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] 10.222.0.36 "GET /compute/v2.1/servers/fa513f2e-6870-4880-b3bf-d4f31e6d0156" status: 200 len: 1470 microversion: 2.1 time: 0.149108 Jul 05 13:05:30.423664 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 315/624] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:05:30 2022] GET /compute/v2.1/servers/fa513f2e-6870-4880-b3bf-d4f31e6d0156 => generated 1470 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:05:30.729197 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-f236ee67-37e9-4dc0-acbb-e361db31a00c tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:30.729816 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-f236ee67-37e9-4dc0-acbb-e361db31a00c tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 7b7f15b2-a00e-4172-983d-f2a80401953b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:30.735962 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f236ee67-37e9-4dc0-acbb-e361db31a00c tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:30.736418 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f236ee67-37e9-4dc0-acbb-e361db31a00c tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:30.737242 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f236ee67-37e9-4dc0-acbb-e361db31a00c tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:30.737681 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f236ee67-37e9-4dc0-acbb-e361db31a00c tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:30.744508 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:05:30.871360 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-f236ee67-37e9-4dc0-acbb-e361db31a00c tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:30.880097 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-f236ee67-37e9-4dc0-acbb-e361db31a00c tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b" status: 200 len: 1735 microversion: 2.1 time: 0.155313 Jul 05 13:05:30.880882 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 310/625] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:05:30 2022] GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:05:31.303760 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [req-21451064-51d9-4c29-a6b8-4d0b163422d7 req-decdf952-5304-4588-9774-bd83cd57e1be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa513f2e-6870-4880-b3bf-d4f31e6d0156", "name": "network-vif-deleted", "tag": "5e9854dc-51db-40e4-879c-710b4640d38e"}]} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:05:31.312995 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-21451064-51d9-4c29-a6b8-4d0b163422d7 req-decdf952-5304-4588-9774-bd83cd57e1be service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:31.313421 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-21451064-51d9-4c29-a6b8-4d0b163422d7 req-decdf952-5304-4588-9774-bd83cd57e1be service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:31.328307 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.compute.server_external_events [req-21451064-51d9-4c29-a6b8-4d0b163422d7 req-decdf952-5304-4588-9774-bd83cd57e1be service nova] Creating event network-vif-deleted:5e9854dc-51db-40e4-879c-710b4640d38e for instance fa513f2e-6870-4880-b3bf-d4f31e6d0156 on hv-cinder-79760 Jul 05 13:05:31.335265 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [req-21451064-51d9-4c29-a6b8-4d0b163422d7 req-decdf952-5304-4588-9774-bd83cd57e1be service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035990 Jul 05 13:05:31.337919 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 316/626] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:05:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 13:05:31.444386 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-8ace41b0-ba1a-4583-9cc7-05a51262785f tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:31.445364 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-8ace41b0-ba1a-4583-9cc7-05a51262785f tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] [instance: fa513f2e-6870-4880-b3bf-d4f31e6d0156] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:31.452278 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8ace41b0-ba1a-4583-9cc7-05a51262785f tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:31.452764 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8ace41b0-ba1a-4583-9cc7-05a51262785f tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:31.453522 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8ace41b0-ba1a-4583-9cc7-05a51262785f tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:31.453953 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8ace41b0-ba1a-4583-9cc7-05a51262785f tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:31.521049 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-8ace41b0-ba1a-4583-9cc7-05a51262785f tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a316766a5e5e490189884369d59c74d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85af5c12238140c4a6334d9b3256f664', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:31.528446 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-8ace41b0-ba1a-4583-9cc7-05a51262785f tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] 10.222.0.36 "GET /compute/v2.1/servers/fa513f2e-6870-4880-b3bf-d4f31e6d0156" status: 200 len: 1300 microversion: 2.1 time: 0.089794 Jul 05 13:05:31.529029 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 311/627] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:05:31 2022] GET /compute/v2.1/servers/fa513f2e-6870-4880-b3bf-d4f31e6d0156 => generated 1300 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:05:31.898004 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-6e394779-3f0a-45c8-ae71-234c453fe917 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:31.898728 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-6e394779-3f0a-45c8-ae71-234c453fe917 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 7b7f15b2-a00e-4172-983d-f2a80401953b] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:31.904958 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-6e394779-3f0a-45c8-ae71-234c453fe917 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:31.905403 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-6e394779-3f0a-45c8-ae71-234c453fe917 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:31.906163 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-6e394779-3f0a-45c8-ae71-234c453fe917 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:31.906592 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-6e394779-3f0a-45c8-ae71-234c453fe917 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:32.045337 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-6e394779-3f0a-45c8-ae71-234c453fe917 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:32.054231 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-6e394779-3f0a-45c8-ae71-234c453fe917 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b" status: 200 len: 1735 microversion: 2.1 time: 0.160576 Jul 05 13:05:32.054812 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 317/628] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:05:31 2022] GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:05:32.545413 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-d86bf90a-c3db-43d5-a88e-046d9cbb05d3 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:32.546027 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-d86bf90a-c3db-43d5-a88e-046d9cbb05d3 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] [instance: fa513f2e-6870-4880-b3bf-d4f31e6d0156] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:32.552557 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d86bf90a-c3db-43d5-a88e-046d9cbb05d3 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:32.553093 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d86bf90a-c3db-43d5-a88e-046d9cbb05d3 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:32.553861 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d86bf90a-c3db-43d5-a88e-046d9cbb05d3 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:32.554297 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d86bf90a-c3db-43d5-a88e-046d9cbb05d3 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:32.567899 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.wsgi [None req-d86bf90a-c3db-43d5-a88e-046d9cbb05d3 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] HTTP exception thrown: Instance fa513f2e-6870-4880-b3bf-d4f31e6d0156 could not be found. Jul 05 13:05:32.569265 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-d86bf90a-c3db-43d5-a88e-046d9cbb05d3 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Request method failure captured: Jul 05 13:05:32.569265 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: request: GET /compute/v2.1/servers/fa513f2e-6870-4880-b3bf-d4f31e6d0156 HTTP/1.1 Jul 05 13:05:32.569265 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept: application/json Jul 05 13:05:32.569265 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept-Encoding: identity Jul 05 13:05:32.569265 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Connection: close Jul 05 13:05:32.569265 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Length: 0 Jul 05 13:05:32.569265 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Type: application/json Jul 05 13:05:32.569265 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Host: 10.222.0.36 Jul 05 13:05:32.569265 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Openstack-System-Scope: None Jul 05 13:05:32.569265 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: User-Agent: python-urllib3/1.26.9 Jul 05 13:05:32.569265 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Auth-Token: gAAAAABixDcGyytkpYxyRn63-BF7XPIInEirn1Gf6Z70IQeJYhAsfTWcslRG_pcAOJCNyUkh8dhUU2NFIu-xosjeybN8uNCPDrW49Zda-ze7m09zutmAmFPorcj3Tmw5Q3Ls3bHuDi_KHo8ZqJ_vgq1woARF4K1DAOtKDBysqKbuSYNU8X1OyuM Jul 05 13:05:32.569265 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Id: None Jul 05 13:05:32.569265 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Name: None Jul 05 13:05:32.569265 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Identity-Status: Confirmed Jul 05 13:05:32.569265 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Is-Admin-Project: True Jul 05 13:05:32.569265 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Id: default Jul 05 13:05:32.569265 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Name: Default Jul 05 13:05:32.569265 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Id: 85af5c12238140c4a6334d9b3256f664 Jul 05 13:05:32.569265 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Name: tempest-VolumesNegativeTest-1356151478 Jul 05 13:05:32.569265 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Role: member,reader Jul 05 13:05:32.569265 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Roles: member,reader Jul 05 13:05:32.570793 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/85af5c12238140c4a6334d9b3256f664"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_85af5c12238140c4a6334d9b3256f664", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/85af5c12238140c4a6334d9b3256f664"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/85af5c12238140c4a6334d9b3256f664"}]}] Jul 05 13:05:32.570793 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant: tempest-VolumesNegativeTest-1356151478 Jul 05 13:05:32.570793 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Id: 85af5c12238140c4a6334d9b3256f664 Jul 05 13:05:32.570793 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Name: tempest-VolumesNegativeTest-1356151478 Jul 05 13:05:32.570793 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User: tempest-VolumesNegativeTest-1356151478-project Jul 05 13:05:32.570793 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Id: default Jul 05 13:05:32.570793 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Name: Default Jul 05 13:05:32.570793 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Id: a316766a5e5e490189884369d59c74d7 Jul 05 13:05:32.570793 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Name: tempest-VolumesNegativeTest-1356151478-project Jul 05 13:05:32.570793 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: method: > Jul 05 13:05:32.570793 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: exception: Instance fa513f2e-6870-4880-b3bf-d4f31e6d0156 could not be found. Jul 05 13:05:32.570793 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: action_args: {'id': 'fa513f2e-6870-4880-b3bf-d4f31e6d0156'} Jul 05 13:05:32.571725 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 13:05:32.571725 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:05:32.571725 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 13:05:32.571725 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 13:05:32.571725 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 13:05:32.571725 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 13:05:32.571725 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 13:05:32.571725 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 13:05:32.571725 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 13:05:32.571725 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 13:05:32.571725 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa513f2e-6870-4880-b3bf-d4f31e6d0156 could not be found. Jul 05 13:05:32.571725 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:05:32.571725 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:05:32.571725 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:05:32.571725 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:05:32.571725 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:05:32.571725 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:05:32.571725 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 13:05:32.571725 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 13:05:32.571725 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 13:05:32.576567 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 13:05:32.576567 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 13:05:32.576567 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 13:05:32.576567 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 13:05:32.576567 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 13:05:32.576567 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 13:05:32.576567 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 13:05:32.576567 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa513f2e-6870-4880-b3bf-d4f31e6d0156 could not be found. Jul 05 13:05:32.576567 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:05:32.576567 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:05:32.576567 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:05:32.576567 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:05:32.576567 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:05:32.576567 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:05:32.576567 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 13:05:32.576567 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 13:05:32.576567 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa513f2e-6870-4880-b3bf-d4f31e6d0156 could not be found. Jul 05 13:05:32.576567 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:05:32.577748 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-d86bf90a-c3db-43d5-a88e-046d9cbb05d3 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] Returning 404 to user: Instance fa513f2e-6870-4880-b3bf-d4f31e6d0156 could not be found. {{(pid=118387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 13:05:32.577748 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-d86bf90a-c3db-43d5-a88e-046d9cbb05d3 tempest-VolumesNegativeTest-1356151478 tempest-VolumesNegativeTest-1356151478-project] 10.222.0.36 "GET /compute/v2.1/servers/fa513f2e-6870-4880-b3bf-d4f31e6d0156" status: 404 len: 111 microversion: 2.1 time: 0.029601 Jul 05 13:05:32.577748 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 312/629] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:05:32 2022] GET /compute/v2.1/servers/fa513f2e-6870-4880-b3bf-d4f31e6d0156 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 13:05:32.875781 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-fe99e343-22b5-4632-b31b-394cd0791a90 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-127280594", "imageRef": "d6134305-a5c0-4d2c-afc8-e54be21f685c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e3e95bfb-f6c2-445d-9afc-40a708c30441"}], "security_groups": [{"name": "tempest-securitygroup--1894635021"}], "key_name": "tempest-keypair-547496300", "user_data": "}} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:05:32.976420 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.network.neutron [None req-fe99e343-22b5-4632-b31b-394cd0791a90 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] validate_networks() for [('e3e95bfb-f6c2-445d-9afc-40a708c30441', None, None, None, None, None)] {{(pid=118386) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 13:05:33.071581 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-09be5c42-526c-4ddd-9ce6-fba27006e33e tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:33.072188 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-09be5c42-526c-4ddd-9ce6-fba27006e33e tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 7b7f15b2-a00e-4172-983d-f2a80401953b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:33.078501 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-09be5c42-526c-4ddd-9ce6-fba27006e33e tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:33.078954 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-09be5c42-526c-4ddd-9ce6-fba27006e33e tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:33.079789 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-09be5c42-526c-4ddd-9ce6-fba27006e33e tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:33.080220 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-09be5c42-526c-4ddd-9ce6-fba27006e33e tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:33.301402 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-09be5c42-526c-4ddd-9ce6-fba27006e33e tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:33.309346 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-09be5c42-526c-4ddd-9ce6-fba27006e33e tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b" status: 200 len: 1735 microversion: 2.1 time: 0.241551 Jul 05 13:05:33.309907 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 313/630] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:05:33 2022] GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b => generated 1735 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:05:33.422257 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.virt.hardware [None req-fe99e343-22b5-4632-b31b-394cd0791a90 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Flavor limits 0:0:0 {{(pid=118386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 13:05:33.422704 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.virt.hardware [None req-fe99e343-22b5-4632-b31b-394cd0791a90 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Image limits 0:0:0 {{(pid=118386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 13:05:33.423201 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.virt.hardware [None req-fe99e343-22b5-4632-b31b-394cd0791a90 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Flavor pref 0:0:0 {{(pid=118386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 13:05:33.423607 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.virt.hardware [None req-fe99e343-22b5-4632-b31b-394cd0791a90 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Image pref 0:0:0 {{(pid=118386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 13:05:33.424014 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.virt.hardware [None req-fe99e343-22b5-4632-b31b-394cd0791a90 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 13:05:33.433955 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-fe99e343-22b5-4632-b31b-394cd0791a90 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:33.434388 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-fe99e343-22b5-4632-b31b-394cd0791a90 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:33.435177 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-fe99e343-22b5-4632-b31b-394cd0791a90 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:33.435603 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-fe99e343-22b5-4632-b31b-394cd0791a90 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:33.452515 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.quota [None req-fe99e343-22b5-4632-b31b-394cd0791a90 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Getting quotas for project 6c201d76ac4e4cc08fdc38e7165d4764. Resources: {'instances', 'cores', 'ram'} {{(pid=118386) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 13:05:33.456654 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.quota [None req-fe99e343-22b5-4632-b31b-394cd0791a90 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Getting quotas for user 475bac060a98475d858e6181eec7ce11 and project 6c201d76ac4e4cc08fdc38e7165d4764. Resources: {'instances', 'cores', 'ram'} {{(pid=118386) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 13:05:33.467613 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-fe99e343-22b5-4632-b31b-394cd0791a90 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Going to run 1 instances... {{(pid=118386) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 13:05:33.469893 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-fe99e343-22b5-4632-b31b-394cd0791a90 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d6134305-a5c0-4d2c-afc8-e54be21f685c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118386) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 13:05:33.492104 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:05:33.638882 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-fe99e343-22b5-4632-b31b-394cd0791a90 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.767378 Jul 05 13:05:33.639631 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 318/631] 10.222.0.36 () {62 vars in 1187 bytes} [Tue Jul 5 13:05:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 769 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 05 13:05:33.649671 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-a2be790f-1383-422a-bcf5-04b7307534d2 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:33.650343 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-a2be790f-1383-422a-bcf5-04b7307534d2 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:33.706038 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-a2be790f-1383-422a-bcf5-04b7307534d2 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:33.713706 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-a2be790f-1383-422a-bcf5-04b7307534d2 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:33.715396 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-a2be790f-1383-422a-bcf5-04b7307534d2 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:33.716727 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-a2be790f-1383-422a-bcf5-04b7307534d2 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356" status: 200 len: 1280 microversion: 2.20 time: 0.070952 Jul 05 13:05:33.717432 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 314/632] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:05:33 2022] GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356 => generated 1280 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:05:34.327338 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-98f5c69c-f6c4-4c2c-82c0-9229f0f5c5fc tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:34.327948 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-98f5c69c-f6c4-4c2c-82c0-9229f0f5c5fc tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 7b7f15b2-a00e-4172-983d-f2a80401953b] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:34.334319 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-98f5c69c-f6c4-4c2c-82c0-9229f0f5c5fc tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:34.336369 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-98f5c69c-f6c4-4c2c-82c0-9229f0f5c5fc tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:34.336369 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-98f5c69c-f6c4-4c2c-82c0-9229f0f5c5fc tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:34.336369 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-98f5c69c-f6c4-4c2c-82c0-9229f0f5c5fc tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:34.474606 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-98f5c69c-f6c4-4c2c-82c0-9229f0f5c5fc tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:34.483259 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-98f5c69c-f6c4-4c2c-82c0-9229f0f5c5fc tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b" status: 200 len: 1735 microversion: 2.1 time: 0.160097 Jul 05 13:05:34.483822 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 319/633] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:05:34 2022] GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:05:34.734800 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-9ad36b3c-9140-42f7-bc07-bebedffd365b tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:34.735491 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-9ad36b3c-9140-42f7-bc07-bebedffd365b tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:34.743327 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9ad36b3c-9140-42f7-bc07-bebedffd365b tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:34.745292 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9ad36b3c-9140-42f7-bc07-bebedffd365b tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:34.745292 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9ad36b3c-9140-42f7-bc07-bebedffd365b tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:34.745292 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9ad36b3c-9140-42f7-bc07-bebedffd365b tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:34.805926 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-9ad36b3c-9140-42f7-bc07-bebedffd365b tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:34.814316 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-9ad36b3c-9140-42f7-bc07-bebedffd365b tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:34.816784 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-9ad36b3c-9140-42f7-bc07-bebedffd365b tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:34.817897 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-9ad36b3c-9140-42f7-bc07-bebedffd365b tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356" status: 200 len: 1284 microversion: 2.20 time: 0.087005 Jul 05 13:05:34.818550 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 315/634] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:05:34 2022] GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356 => generated 1284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:05:35.503619 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-79cc3e62-4270-4a71-9e27-f7e3ce3822bc tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:35.503619 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-79cc3e62-4270-4a71-9e27-f7e3ce3822bc tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 7b7f15b2-a00e-4172-983d-f2a80401953b] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:35.509042 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-79cc3e62-4270-4a71-9e27-f7e3ce3822bc tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:35.509489 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-79cc3e62-4270-4a71-9e27-f7e3ce3822bc tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:35.510253 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-79cc3e62-4270-4a71-9e27-f7e3ce3822bc tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:35.510676 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-79cc3e62-4270-4a71-9e27-f7e3ce3822bc tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:35.645458 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-79cc3e62-4270-4a71-9e27-f7e3ce3822bc tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:35.653322 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-79cc3e62-4270-4a71-9e27-f7e3ce3822bc tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b" status: 200 len: 1735 microversion: 2.1 time: 0.155595 Jul 05 13:05:35.653881 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 320/635] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:05:35 2022] GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:05:35.837721 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-d10d3c27-fb44-4931-a7b7-6a5ad14d8c73 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:35.838341 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-d10d3c27-fb44-4931-a7b7-6a5ad14d8c73 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:35.846422 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d10d3c27-fb44-4931-a7b7-6a5ad14d8c73 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:35.846974 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d10d3c27-fb44-4931-a7b7-6a5ad14d8c73 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:35.847755 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d10d3c27-fb44-4931-a7b7-6a5ad14d8c73 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:35.848202 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d10d3c27-fb44-4931-a7b7-6a5ad14d8c73 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:35.916175 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-d10d3c27-fb44-4931-a7b7-6a5ad14d8c73 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:35.925606 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-d10d3c27-fb44-4931-a7b7-6a5ad14d8c73 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:35.927157 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-d10d3c27-fb44-4931-a7b7-6a5ad14d8c73 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:35.928264 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-d10d3c27-fb44-4931-a7b7-6a5ad14d8c73 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356" status: 200 len: 1332 microversion: 2.20 time: 0.096251 Jul 05 13:05:35.928837 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 316/636] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:05:35 2022] GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356 => generated 1332 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 13:05:36.678671 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-771c90fb-a088-45f6-b3cd-d547030fb2b2 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:36.678671 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-771c90fb-a088-45f6-b3cd-d547030fb2b2 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 7b7f15b2-a00e-4172-983d-f2a80401953b] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:36.678671 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-771c90fb-a088-45f6-b3cd-d547030fb2b2 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:36.678671 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-771c90fb-a088-45f6-b3cd-d547030fb2b2 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:36.679381 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-771c90fb-a088-45f6-b3cd-d547030fb2b2 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:36.679475 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-771c90fb-a088-45f6-b3cd-d547030fb2b2 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:36.836351 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-771c90fb-a088-45f6-b3cd-d547030fb2b2 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:36.843318 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-771c90fb-a088-45f6-b3cd-d547030fb2b2 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b" status: 200 len: 1715 microversion: 2.1 time: 0.176559 Jul 05 13:05:36.844345 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 321/637] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:05:36 2022] GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b => generated 1715 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:05:36.948508 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-a271d0c2-c9f6-45f8-b931-9010f8045bf4 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:36.949156 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-a271d0c2-c9f6-45f8-b931-9010f8045bf4 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:36.957132 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a271d0c2-c9f6-45f8-b931-9010f8045bf4 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:36.957579 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a271d0c2-c9f6-45f8-b931-9010f8045bf4 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:36.958345 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a271d0c2-c9f6-45f8-b931-9010f8045bf4 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:36.958777 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a271d0c2-c9f6-45f8-b931-9010f8045bf4 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:36.960456 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-2a74ca93-0647-4568-9ca9-0a89df80baac tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:36.961032 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-2a74ca93-0647-4568-9ca9-0a89df80baac tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 7b7f15b2-a00e-4172-983d-f2a80401953b] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:36.969607 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-2a74ca93-0647-4568-9ca9-0a89df80baac tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:36.970036 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-2a74ca93-0647-4568-9ca9-0a89df80baac tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:36.970805 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-2a74ca93-0647-4568-9ca9-0a89df80baac tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:36.971257 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-2a74ca93-0647-4568-9ca9-0a89df80baac tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:37.031879 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-a271d0c2-c9f6-45f8-b931-9010f8045bf4 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:37.042748 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-a271d0c2-c9f6-45f8-b931-9010f8045bf4 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:37.044655 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-a271d0c2-c9f6-45f8-b931-9010f8045bf4 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:37.046323 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-a271d0c2-c9f6-45f8-b931-9010f8045bf4 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356" status: 200 len: 1340 microversion: 2.20 time: 0.101456 Jul 05 13:05:37.047736 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 317/638] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:05:36 2022] GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356 => generated 1340 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:05:37.125353 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.wsgi [None req-2a74ca93-0647-4568-9ca9-0a89df80baac tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] HTTP exception thrown: Cannot 'detach_volume' instance 7b7f15b2-a00e-4172-983d-f2a80401953b while it is in vm_state rescued Jul 05 13:05:37.126973 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-2a74ca93-0647-4568-9ca9-0a89df80baac tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Request method failure captured: Jul 05 13:05:37.126973 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: request: DELETE /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b/os-volume_attachments/055e4eb6-4954-4d2b-b41a-8a296f54ac26 HTTP/1.1 Jul 05 13:05:37.126973 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Accept: application/json Jul 05 13:05:37.126973 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Accept-Encoding: identity Jul 05 13:05:37.126973 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Connection: close Jul 05 13:05:37.126973 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Content-Length: 0 Jul 05 13:05:37.126973 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Content-Type: application/json Jul 05 13:05:37.126973 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Host: 10.222.0.36 Jul 05 13:05:37.126973 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Openstack-System-Scope: None Jul 05 13:05:37.126973 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: User-Agent: python-urllib3/1.26.9 Jul 05 13:05:37.126973 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Auth-Token: gAAAAABixDYWYD5-KTSWF-PzN5qO1tc1RakdLPjXfBvilDWsQo1psKh_qFRHuHivkKH-iP9Oa3e_8UzczAUBoqaCyIK-0JWYeWftSmLFPiSBm9nSNsIqZmt-IbMLoXnltVymxxX8qTTGlTfGqbh0uv6ByTxeigZY20vapbgvLdiiGRX9KHkTM5M Jul 05 13:05:37.126973 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Domain-Id: None Jul 05 13:05:37.126973 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Domain-Name: None Jul 05 13:05:37.126973 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Identity-Status: Confirmed Jul 05 13:05:37.126973 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Is-Admin-Project: True Jul 05 13:05:37.126973 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Domain-Id: default Jul 05 13:05:37.126973 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Domain-Name: Default Jul 05 13:05:37.126973 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Id: 7836a0ee154744b49a323e6b94860e50 Jul 05 13:05:37.126973 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1330957121 Jul 05 13:05:37.126973 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Role: member,reader Jul 05 13:05:37.126973 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Roles: member,reader Jul 05 13:05:37.129467 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7836a0ee154744b49a323e6b94860e50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7836a0ee154744b49a323e6b94860e50", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7836a0ee154744b49a323e6b94860e50"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7836a0ee154744b49a323e6b94860e50"}]}] Jul 05 13:05:37.129467 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1330957121 Jul 05 13:05:37.129467 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Tenant-Id: 7836a0ee154744b49a323e6b94860e50 Jul 05 13:05:37.129467 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1330957121 Jul 05 13:05:37.129467 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User: tempest-ServerRescueNegativeTestJSON-1330957121-project Jul 05 13:05:37.129467 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Domain-Id: default Jul 05 13:05:37.129467 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Domain-Name: Default Jul 05 13:05:37.129467 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Id: ad3f91c024f8415cac4784fec0689757 Jul 05 13:05:37.129467 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1330957121-project Jul 05 13:05:37.129467 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: method: > Jul 05 13:05:37.129467 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: exception: Cannot 'detach_volume' instance 7b7f15b2-a00e-4172-983d-f2a80401953b while it is in vm_state rescued Jul 05 13:05:37.130523 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: action_args: {'server_id': '7b7f15b2-a00e-4172-983d-f2a80401953b', 'id': '055e4eb6-4954-4d2b-b41a-8a296f54ac26'} Jul 05 13:05:37.130523 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 13:05:37.130523 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:05:37.130523 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 05 13:05:37.130523 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 05 13:05:37.130523 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 05 13:05:37.130523 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 05 13:05:37.130523 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 05 13:05:37.130523 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 05 13:05:37.130523 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7b7f15b2-a00e-4172-983d-f2a80401953b in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 05 13:05:37.130523 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:05:37.130523 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:05:37.130523 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:05:37.130523 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:05:37.130523 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:05:37.130523 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:05:37.130523 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 13:05:37.130523 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 13:05:37.130523 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 13:05:37.130523 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 13:05:37.131928 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 05 13:05:37.131928 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 05 13:05:37.131928 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 05 13:05:37.131928 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 05 13:05:37.131928 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 7b7f15b2-a00e-4172-983d-f2a80401953b while it is in vm_state rescued Jul 05 13:05:37.131928 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:05:37.131928 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:05:37.131928 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:05:37.131928 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:05:37.131928 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:05:37.131928 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:05:37.131928 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 13:05:37.131928 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 13:05:37.131928 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 7b7f15b2-a00e-4172-983d-f2a80401953b while it is in vm_state rescued Jul 05 13:05:37.131928 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:05:37.131928 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-2a74ca93-0647-4568-9ca9-0a89df80baac tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Returning 409 to user: Cannot 'detach_volume' instance 7b7f15b2-a00e-4172-983d-f2a80401953b while it is in vm_state rescued {{(pid=118386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 13:05:37.133241 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-2a74ca93-0647-4568-9ca9-0a89df80baac tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "DELETE /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b/os-volume_attachments/055e4eb6-4954-4d2b-b41a-8a296f54ac26" status: 409 len: 152 microversion: 2.1 time: 0.173838 Jul 05 13:05:37.133241 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 322/639] 10.222.0.36 () {58 vars in 1415 bytes} [Tue Jul 5 13:05:36 2022] DELETE /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b/os-volume_attachments/055e4eb6-4954-4d2b-b41a-8a296f54ac26 => generated 152 bytes in 175 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 05 13:05:37.137975 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-c82ea6ee-d19f-4a58-a0e7-6ba62f7d39e1 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:05:37.138521 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-c82ea6ee-d19f-4a58-a0e7-6ba62f7d39e1 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 7b7f15b2-a00e-4172-983d-f2a80401953b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:37.145146 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c82ea6ee-d19f-4a58-a0e7-6ba62f7d39e1 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:37.145586 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c82ea6ee-d19f-4a58-a0e7-6ba62f7d39e1 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:37.146535 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c82ea6ee-d19f-4a58-a0e7-6ba62f7d39e1 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:37.146987 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c82ea6ee-d19f-4a58-a0e7-6ba62f7d39e1 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:37.384136 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-c82ea6ee-d19f-4a58-a0e7-6ba62f7d39e1 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "POST /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b/action" status: 202 len: 0 microversion: 2.1 time: 0.249999 Jul 05 13:05:37.388744 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 318/640] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Jul 5 13:05:37 2022] POST /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 05 13:05:37.393085 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-210c0502-3926-4b7f-b8c5-3f290ad48d34 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:37.393791 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-210c0502-3926-4b7f-b8c5-3f290ad48d34 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 7b7f15b2-a00e-4172-983d-f2a80401953b] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:37.402989 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-210c0502-3926-4b7f-b8c5-3f290ad48d34 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:37.403429 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-210c0502-3926-4b7f-b8c5-3f290ad48d34 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:37.404196 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-210c0502-3926-4b7f-b8c5-3f290ad48d34 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:37.404796 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-210c0502-3926-4b7f-b8c5-3f290ad48d34 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:37.543296 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-210c0502-3926-4b7f-b8c5-3f290ad48d34 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:37.552650 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-210c0502-3926-4b7f-b8c5-3f290ad48d34 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b" status: 200 len: 1723 microversion: 2.1 time: 0.163227 Jul 05 13:05:37.553364 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 323/641] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:05:37 2022] GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:05:38.070440 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-00f12eba-71bf-4f85-a08e-0745e9e05ddc tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:38.074429 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-00f12eba-71bf-4f85-a08e-0745e9e05ddc tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:38.078280 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-00f12eba-71bf-4f85-a08e-0745e9e05ddc tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:38.079484 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-00f12eba-71bf-4f85-a08e-0745e9e05ddc tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:38.080450 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-00f12eba-71bf-4f85-a08e-0745e9e05ddc tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:38.081432 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-00f12eba-71bf-4f85-a08e-0745e9e05ddc tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:38.231264 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-00f12eba-71bf-4f85-a08e-0745e9e05ddc tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:38.245307 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-00f12eba-71bf-4f85-a08e-0745e9e05ddc tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:38.245307 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-00f12eba-71bf-4f85-a08e-0745e9e05ddc tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:38.245307 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-00f12eba-71bf-4f85-a08e-0745e9e05ddc tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356" status: 200 len: 1406 microversion: 2.20 time: 0.181497 Jul 05 13:05:38.245810 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 319/642] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:05:38 2022] GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356 => generated 1406 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:05:38.572402 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-e70fe4b5-b37c-46eb-a1ac-f28c6b291b59 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:38.573156 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-e70fe4b5-b37c-46eb-a1ac-f28c6b291b59 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 7b7f15b2-a00e-4172-983d-f2a80401953b] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:38.582658 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e70fe4b5-b37c-46eb-a1ac-f28c6b291b59 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:38.584181 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e70fe4b5-b37c-46eb-a1ac-f28c6b291b59 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:38.584521 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e70fe4b5-b37c-46eb-a1ac-f28c6b291b59 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:38.585054 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e70fe4b5-b37c-46eb-a1ac-f28c6b291b59 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:38.723939 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-e70fe4b5-b37c-46eb-a1ac-f28c6b291b59 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:38.735667 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-e70fe4b5-b37c-46eb-a1ac-f28c6b291b59 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b" status: 200 len: 1723 microversion: 2.1 time: 0.168242 Jul 05 13:05:38.736857 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 324/643] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:05:38 2022] GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:05:39.037862 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-566383db-fbca-40a3-965e-66b367c0c6d0 req-e0b1d36d-c8fb-41b7-8787-d93bb45bb53c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42411ae1-103e-4934-9594-aaf06cc8a356", "tag": "0eb7994b-94fe-4d89-a3c9-6b498bab0720"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:05:39.046038 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-566383db-fbca-40a3-965e-66b367c0c6d0 req-e0b1d36d-c8fb-41b7-8787-d93bb45bb53c service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:39.046682 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-566383db-fbca-40a3-965e-66b367c0c6d0 req-e0b1d36d-c8fb-41b7-8787-d93bb45bb53c service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:39.071318 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-566383db-fbca-40a3-965e-66b367c0c6d0 req-e0b1d36d-c8fb-41b7-8787-d93bb45bb53c service nova] Creating event network-changed:0eb7994b-94fe-4d89-a3c9-6b498bab0720 for instance 42411ae1-103e-4934-9594-aaf06cc8a356 on hv-cinder-79760 Jul 05 13:05:39.077919 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-566383db-fbca-40a3-965e-66b367c0c6d0 req-e0b1d36d-c8fb-41b7-8787-d93bb45bb53c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044285 Jul 05 13:05:39.079077 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 320/644] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:05:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:05:39.261390 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-26e55f68-e854-43f2-b586-63fa35fe94d9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:39.261918 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-26e55f68-e854-43f2-b586-63fa35fe94d9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:39.267949 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-26e55f68-e854-43f2-b586-63fa35fe94d9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:39.268420 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-26e55f68-e854-43f2-b586-63fa35fe94d9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:39.269201 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-26e55f68-e854-43f2-b586-63fa35fe94d9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:39.269624 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-26e55f68-e854-43f2-b586-63fa35fe94d9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:39.401074 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-26e55f68-e854-43f2-b586-63fa35fe94d9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:39.410865 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-26e55f68-e854-43f2-b586-63fa35fe94d9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:39.412357 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-26e55f68-e854-43f2-b586-63fa35fe94d9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:39.413479 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-26e55f68-e854-43f2-b586-63fa35fe94d9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356" status: 200 len: 1406 microversion: 2.20 time: 0.156041 Jul 05 13:05:39.414133 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 325/645] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:05:39 2022] GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 13:05:39.754584 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-8e183528-27b0-4ca5-9518-76c368925633 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:39.755317 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-8e183528-27b0-4ca5-9518-76c368925633 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 7b7f15b2-a00e-4172-983d-f2a80401953b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:39.766744 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8e183528-27b0-4ca5-9518-76c368925633 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:39.766744 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8e183528-27b0-4ca5-9518-76c368925633 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:39.766744 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8e183528-27b0-4ca5-9518-76c368925633 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:39.766744 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8e183528-27b0-4ca5-9518-76c368925633 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:39.907620 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-8e183528-27b0-4ca5-9518-76c368925633 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:39.915751 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-8e183528-27b0-4ca5-9518-76c368925633 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b" status: 200 len: 1723 microversion: 2.1 time: 0.165346 Jul 05 13:05:39.916325 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 321/646] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:05:39 2022] GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:05:40.430933 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-f6753ae4-ba9b-43e5-a629-c4f9cc2e02e3 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:40.431570 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-f6753ae4-ba9b-43e5-a629-c4f9cc2e02e3 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:40.439835 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f6753ae4-ba9b-43e5-a629-c4f9cc2e02e3 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:40.440886 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f6753ae4-ba9b-43e5-a629-c4f9cc2e02e3 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:40.441833 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f6753ae4-ba9b-43e5-a629-c4f9cc2e02e3 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:40.442417 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f6753ae4-ba9b-43e5-a629-c4f9cc2e02e3 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:40.582528 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-f6753ae4-ba9b-43e5-a629-c4f9cc2e02e3 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:40.591564 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-f6753ae4-ba9b-43e5-a629-c4f9cc2e02e3 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:40.593360 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-f6753ae4-ba9b-43e5-a629-c4f9cc2e02e3 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:40.594506 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-f6753ae4-ba9b-43e5-a629-c4f9cc2e02e3 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356" status: 200 len: 1406 microversion: 2.20 time: 0.167409 Jul 05 13:05:40.595123 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 326/647] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:05:40 2022] GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356 => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:05:40.932429 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-6eaaec12-5b85-468d-af7b-0a399260ef1d tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:40.933081 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-6eaaec12-5b85-468d-af7b-0a399260ef1d tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 7b7f15b2-a00e-4172-983d-f2a80401953b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:40.939897 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6eaaec12-5b85-468d-af7b-0a399260ef1d tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:40.940404 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6eaaec12-5b85-468d-af7b-0a399260ef1d tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:40.941205 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6eaaec12-5b85-468d-af7b-0a399260ef1d tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:40.941647 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6eaaec12-5b85-468d-af7b-0a399260ef1d tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:41.078025 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-6eaaec12-5b85-468d-af7b-0a399260ef1d tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:41.086815 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-6eaaec12-5b85-468d-af7b-0a399260ef1d tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b" status: 200 len: 1729 microversion: 2.1 time: 0.158480 Jul 05 13:05:41.087401 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 322/648] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:05:40 2022] GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:05:41.106323 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-badb92d3-0553-47ad-80b3-6cf4f5fb0c72 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:41.106819 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-badb92d3-0553-47ad-80b3-6cf4f5fb0c72 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 7b7f15b2-a00e-4172-983d-f2a80401953b] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:41.113065 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-badb92d3-0553-47ad-80b3-6cf4f5fb0c72 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:41.113515 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-badb92d3-0553-47ad-80b3-6cf4f5fb0c72 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:41.114425 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-badb92d3-0553-47ad-80b3-6cf4f5fb0c72 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:41.114856 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-badb92d3-0553-47ad-80b3-6cf4f5fb0c72 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:41.195821 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-badb92d3-0553-47ad-80b3-6cf4f5fb0c72 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093676 Jul 05 13:05:41.196415 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 327/649] 10.222.0.36 () {58 vars in 1274 bytes} [Tue Jul 5 13:05:41 2022] GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:05:41.613442 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-653b52bb-d0d0-48fb-9b26-1015aa8dd3a5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:41.614172 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-653b52bb-d0d0-48fb-9b26-1015aa8dd3a5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:41.620089 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-653b52bb-d0d0-48fb-9b26-1015aa8dd3a5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:41.620542 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-653b52bb-d0d0-48fb-9b26-1015aa8dd3a5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:41.621342 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-653b52bb-d0d0-48fb-9b26-1015aa8dd3a5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:41.621794 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-653b52bb-d0d0-48fb-9b26-1015aa8dd3a5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:42.025298 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-653b52bb-d0d0-48fb-9b26-1015aa8dd3a5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:42.033211 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-653b52bb-d0d0-48fb-9b26-1015aa8dd3a5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:42.034758 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-653b52bb-d0d0-48fb-9b26-1015aa8dd3a5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:42.035847 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-653b52bb-d0d0-48fb-9b26-1015aa8dd3a5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356" status: 200 len: 1406 microversion: 2.20 time: 0.426404 Jul 05 13:05:42.036396 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 323/650] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:05:41 2022] GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356 => generated 1406 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:05:42.431231 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [req-6cbe7e68-52cc-4abf-8323-da06ac9798e0 req-b9511716-59bb-4847-9a08-268efebbc088 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b7f15b2-a00e-4172-983d-f2a80401953b", "tag": "31d1ed43-9fb9-4a56-aa9d-2fb0657cefdc"}]} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:05:42.439615 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-6cbe7e68-52cc-4abf-8323-da06ac9798e0 req-b9511716-59bb-4847-9a08-268efebbc088 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:42.440044 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-6cbe7e68-52cc-4abf-8323-da06ac9798e0 req-b9511716-59bb-4847-9a08-268efebbc088 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:42.451785 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.compute.server_external_events [req-6cbe7e68-52cc-4abf-8323-da06ac9798e0 req-b9511716-59bb-4847-9a08-268efebbc088 service nova] Creating event network-changed:31d1ed43-9fb9-4a56-aa9d-2fb0657cefdc for instance 7b7f15b2-a00e-4172-983d-f2a80401953b on hv-cinder-79760 Jul 05 13:05:42.461387 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [req-6cbe7e68-52cc-4abf-8323-da06ac9798e0 req-b9511716-59bb-4847-9a08-268efebbc088 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032727 Jul 05 13:05:42.463284 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 328/651] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:05:43.053728 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-84d41eb5-b933-4928-8bff-a127e8070d33 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:43.055126 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-84d41eb5-b933-4928-8bff-a127e8070d33 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:43.061863 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-84d41eb5-b933-4928-8bff-a127e8070d33 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:43.062601 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-84d41eb5-b933-4928-8bff-a127e8070d33 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:43.063593 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-84d41eb5-b933-4928-8bff-a127e8070d33 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:43.064233 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-84d41eb5-b933-4928-8bff-a127e8070d33 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:43.197866 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-84d41eb5-b933-4928-8bff-a127e8070d33 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:43.206519 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-84d41eb5-b933-4928-8bff-a127e8070d33 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:43.208024 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-84d41eb5-b933-4928-8bff-a127e8070d33 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:43.209179 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-84d41eb5-b933-4928-8bff-a127e8070d33 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356" status: 200 len: 1406 microversion: 2.20 time: 0.159328 Jul 05 13:05:43.209729 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 324/652] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:05:43 2022] GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:05:44.227658 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-cfa62d81-d21f-4414-839f-46f0ad9d2a40 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:44.228341 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-cfa62d81-d21f-4414-839f-46f0ad9d2a40 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:44.230555 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_cell0:SELECT=2 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:05:44.231206 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_cell0:SELECT=6 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:05:44.236281 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-cfa62d81-d21f-4414-839f-46f0ad9d2a40 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:44.236803 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-cfa62d81-d21f-4414-839f-46f0ad9d2a40 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:44.238154 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-cfa62d81-d21f-4414-839f-46f0ad9d2a40 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:44.238581 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-cfa62d81-d21f-4414-839f-46f0ad9d2a40 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:44.369158 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-cfa62d81-d21f-4414-839f-46f0ad9d2a40 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:44.376938 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-cfa62d81-d21f-4414-839f-46f0ad9d2a40 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:44.378431 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-cfa62d81-d21f-4414-839f-46f0ad9d2a40 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:44.379546 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-cfa62d81-d21f-4414-839f-46f0ad9d2a40 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356" status: 200 len: 1406 microversion: 2.20 time: 0.156525 Jul 05 13:05:44.380100 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 329/653] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:05:44 2022] GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:05:44.531456 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-2ab86131-e096-458f-beb8-c3950b3a9fb6 req-08fee0ba-de30-4ebb-90fe-c8e6715b3f2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b7f15b2-a00e-4172-983d-f2a80401953b", "tag": "31d1ed43-9fb9-4a56-aa9d-2fb0657cefdc"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:05:44.531456 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell0:SELECT=6 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:05:44.531456 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-2ab86131-e096-458f-beb8-c3950b3a9fb6 req-08fee0ba-de30-4ebb-90fe-c8e6715b3f2f service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:44.531456 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-2ab86131-e096-458f-beb8-c3950b3a9fb6 req-08fee0ba-de30-4ebb-90fe-c8e6715b3f2f service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:44.532907 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-2ab86131-e096-458f-beb8-c3950b3a9fb6 req-08fee0ba-de30-4ebb-90fe-c8e6715b3f2f service nova] Creating event network-changed:31d1ed43-9fb9-4a56-aa9d-2fb0657cefdc for instance 7b7f15b2-a00e-4172-983d-f2a80401953b on hv-cinder-79760 Jul 05 13:05:44.532907 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-2ab86131-e096-458f-beb8-c3950b3a9fb6 req-08fee0ba-de30-4ebb-90fe-c8e6715b3f2f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030058 Jul 05 13:05:44.532907 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 325/654] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:05:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 13:05:45.397147 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-ad2b3884-62ce-4648-beaf-5538df543279 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:45.397699 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-ad2b3884-62ce-4648-beaf-5538df543279 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:45.403835 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ad2b3884-62ce-4648-beaf-5538df543279 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:45.404272 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ad2b3884-62ce-4648-beaf-5538df543279 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:45.405051 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ad2b3884-62ce-4648-beaf-5538df543279 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:45.405741 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ad2b3884-62ce-4648-beaf-5538df543279 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:45.532932 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-ad2b3884-62ce-4648-beaf-5538df543279 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:45.541305 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-ad2b3884-62ce-4648-beaf-5538df543279 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:45.542784 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-ad2b3884-62ce-4648-beaf-5538df543279 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:45.543902 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-ad2b3884-62ce-4648-beaf-5538df543279 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356" status: 200 len: 1406 microversion: 2.20 time: 0.150691 Jul 05 13:05:45.544446 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 330/655] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:05:45 2022] GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356 => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:05:46.562963 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-c3126757-2520-4782-aac5-4977710765ee tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:46.563691 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-c3126757-2520-4782-aac5-4977710765ee tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:46.570685 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c3126757-2520-4782-aac5-4977710765ee tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:46.571137 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c3126757-2520-4782-aac5-4977710765ee tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:46.571889 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c3126757-2520-4782-aac5-4977710765ee tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:46.572324 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c3126757-2520-4782-aac5-4977710765ee tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:46.699322 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-c3126757-2520-4782-aac5-4977710765ee tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:46.707295 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-c3126757-2520-4782-aac5-4977710765ee tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:46.708831 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-c3126757-2520-4782-aac5-4977710765ee tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:46.709934 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-c3126757-2520-4782-aac5-4977710765ee tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356" status: 200 len: 1406 microversion: 2.20 time: 0.152193 Jul 05 13:05:46.710488 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 326/656] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:05:46 2022] GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:05:47.528440 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [req-79dea21e-45c8-46f4-a151-5ad984dc58c8 req-14f15920-6682-4fd2-b7b8-5de095133227 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42411ae1-103e-4934-9594-aaf06cc8a356", "name": "network-vif-plugged", "status": "completed", "tag": "0eb7994b-94fe-4d89-a3c9-6b498bab0720"}]} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:05:47.536669 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-79dea21e-45c8-46f4-a151-5ad984dc58c8 req-14f15920-6682-4fd2-b7b8-5de095133227 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:47.537180 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-79dea21e-45c8-46f4-a151-5ad984dc58c8 req-14f15920-6682-4fd2-b7b8-5de095133227 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:47.548116 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.compute.server_external_events [req-79dea21e-45c8-46f4-a151-5ad984dc58c8 req-14f15920-6682-4fd2-b7b8-5de095133227 service nova] Creating event network-vif-plugged:0eb7994b-94fe-4d89-a3c9-6b498bab0720 for instance 42411ae1-103e-4934-9594-aaf06cc8a356 on hv-cinder-79760 Jul 05 13:05:47.553224 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [req-79dea21e-45c8-46f4-a151-5ad984dc58c8 req-14f15920-6682-4fd2-b7b8-5de095133227 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028174 Jul 05 13:05:47.553893 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 331/657] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 13:05:47.728550 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-6b76c7d6-2c49-4392-a40f-e647f055295f tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:47.729493 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-6b76c7d6-2c49-4392-a40f-e647f055295f tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:47.736472 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6b76c7d6-2c49-4392-a40f-e647f055295f tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:47.736976 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6b76c7d6-2c49-4392-a40f-e647f055295f tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:47.738300 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6b76c7d6-2c49-4392-a40f-e647f055295f tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:47.738738 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6b76c7d6-2c49-4392-a40f-e647f055295f tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:47.874541 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-6b76c7d6-2c49-4392-a40f-e647f055295f tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:47.884492 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-6b76c7d6-2c49-4392-a40f-e647f055295f tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:47.887145 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-6b76c7d6-2c49-4392-a40f-e647f055295f tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:47.887274 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-6b76c7d6-2c49-4392-a40f-e647f055295f tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356" status: 200 len: 1406 microversion: 2.20 time: 0.163746 Jul 05 13:05:47.887732 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 327/658] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:05:47 2022] GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:05:48.905362 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-24814565-90db-4c05-9fea-fdf11ac395ca tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:48.906324 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-24814565-90db-4c05-9fea-fdf11ac395ca tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:48.912646 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-24814565-90db-4c05-9fea-fdf11ac395ca tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:48.913098 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-24814565-90db-4c05-9fea-fdf11ac395ca tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:48.913916 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-24814565-90db-4c05-9fea-fdf11ac395ca tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:48.914351 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-24814565-90db-4c05-9fea-fdf11ac395ca tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:49.042902 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-24814565-90db-4c05-9fea-fdf11ac395ca tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:49.046385 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_cell1:SELECT=100 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:05:49.051407 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-24814565-90db-4c05-9fea-fdf11ac395ca tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:49.053058 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-24814565-90db-4c05-9fea-fdf11ac395ca tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:49.054159 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-24814565-90db-4c05-9fea-fdf11ac395ca tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356" status: 200 len: 1406 microversion: 2.20 time: 0.153429 Jul 05 13:05:49.054978 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 332/659] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:05:48 2022] GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:05:50.071180 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-2dbf3e51-7f41-48d1-ad24-ed65facf63bc tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:50.071787 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-2dbf3e51-7f41-48d1-ad24-ed65facf63bc tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:50.078261 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2dbf3e51-7f41-48d1-ad24-ed65facf63bc tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:50.078712 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2dbf3e51-7f41-48d1-ad24-ed65facf63bc tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:50.079463 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2dbf3e51-7f41-48d1-ad24-ed65facf63bc tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:50.079896 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2dbf3e51-7f41-48d1-ad24-ed65facf63bc tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:50.253921 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-2dbf3e51-7f41-48d1-ad24-ed65facf63bc tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:50.256237 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:05:50.262515 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-2dbf3e51-7f41-48d1-ad24-ed65facf63bc tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:50.264053 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-2dbf3e51-7f41-48d1-ad24-ed65facf63bc tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:50.265191 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-2dbf3e51-7f41-48d1-ad24-ed65facf63bc tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356" status: 200 len: 1406 microversion: 2.20 time: 0.197877 Jul 05 13:05:50.265757 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 328/660] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:05:50 2022] GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356 => generated 1406 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:05:51.284696 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-561cb71e-0e90-4b5d-9d62-e120600de937 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:51.285291 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-561cb71e-0e90-4b5d-9d62-e120600de937 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:51.291450 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-561cb71e-0e90-4b5d-9d62-e120600de937 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:51.291890 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-561cb71e-0e90-4b5d-9d62-e120600de937 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:51.292669 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-561cb71e-0e90-4b5d-9d62-e120600de937 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:51.293136 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-561cb71e-0e90-4b5d-9d62-e120600de937 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:51.417344 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-561cb71e-0e90-4b5d-9d62-e120600de937 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:51.425773 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-561cb71e-0e90-4b5d-9d62-e120600de937 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:51.427264 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-561cb71e-0e90-4b5d-9d62-e120600de937 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:05:51.428402 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-561cb71e-0e90-4b5d-9d62-e120600de937 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356" status: 200 len: 1598 microversion: 2.20 time: 0.148501 Jul 05 13:05:51.428991 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 333/661] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:05:51 2022] GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356 => generated 1598 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:05:51.445707 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-ee3eb704-67d1-4723-8570-313b82642a4c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:51.446218 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-ee3eb704-67d1-4723-8570-313b82642a4c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:51.448413 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:05:51.453386 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ee3eb704-67d1-4723-8570-313b82642a4c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:51.453832 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ee3eb704-67d1-4723-8570-313b82642a4c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:51.454583 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ee3eb704-67d1-4723-8570-313b82642a4c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:51.455009 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ee3eb704-67d1-4723-8570-313b82642a4c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:51.535346 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-ee3eb704-67d1-4723-8570-313b82642a4c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.093710 Jul 05 13:05:51.535940 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 329/662] 10.222.0.36 () {60 vars in 1315 bytes} [Tue Jul 5 13:05:51 2022] GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 13:05:52.542817 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [req-4bbdc146-4247-4a23-8779-d153a25bfdae req-6fd46744-af5b-4754-b76e-8bf00f08d828 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42411ae1-103e-4934-9594-aaf06cc8a356", "tag": "0eb7994b-94fe-4d89-a3c9-6b498bab0720"}]} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:05:52.551133 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-4bbdc146-4247-4a23-8779-d153a25bfdae req-6fd46744-af5b-4754-b76e-8bf00f08d828 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:52.551651 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-4bbdc146-4247-4a23-8779-d153a25bfdae req-6fd46744-af5b-4754-b76e-8bf00f08d828 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:52.563004 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.compute.server_external_events [req-4bbdc146-4247-4a23-8779-d153a25bfdae req-6fd46744-af5b-4754-b76e-8bf00f08d828 service nova] Creating event network-changed:0eb7994b-94fe-4d89-a3c9-6b498bab0720 for instance 42411ae1-103e-4934-9594-aaf06cc8a356 on hv-cinder-79760 Jul 05 13:05:52.568239 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [req-4bbdc146-4247-4a23-8779-d153a25bfdae req-6fd46744-af5b-4754-b76e-8bf00f08d828 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029138 Jul 05 13:05:52.568868 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 334/663] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:05:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:05:57.439698 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-07cddaf8-fd9b-402d-992b-a6c6d92f9b0c tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:05:57.440224 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-07cddaf8-fd9b-402d-992b-a6c6d92f9b0c tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: ec256177-0365-4a8e-af6c-56f68a6f9a54] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:57.447720 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-07cddaf8-fd9b-402d-992b-a6c6d92f9b0c tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:57.448160 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-07cddaf8-fd9b-402d-992b-a6c6d92f9b0c tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:57.448952 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-07cddaf8-fd9b-402d-992b-a6c6d92f9b0c tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:57.449375 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-07cddaf8-fd9b-402d-992b-a6c6d92f9b0c tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:57.471636 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-07cddaf8-fd9b-402d-992b-a6c6d92f9b0c tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/ec256177-0365-4a8e-af6c-56f68a6f9a54/ips" status: 200 len: 150 microversion: 2.1 time: 0.037545 Jul 05 13:05:57.472201 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 330/664] 10.222.0.36 () {58 vars in 1247 bytes} [Tue Jul 5 13:05:57 2022] GET /compute/v2.1/servers/ec256177-0365-4a8e-af6c-56f68a6f9a54/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:05:59.096800 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-58c8eb8a-21a9-42cf-8ad6-4e8cba0adc9e tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "35ac642d-fb08-43fc-b63f-4eaf22a96ca8"}} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:05:59.100605 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-58c8eb8a-21a9-42cf-8ad6-4e8cba0adc9e tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: ec256177-0365-4a8e-af6c-56f68a6f9a54] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:05:59.104404 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-58c8eb8a-21a9-42cf-8ad6-4e8cba0adc9e tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:59.104868 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-58c8eb8a-21a9-42cf-8ad6-4e8cba0adc9e tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:05:59.105630 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-58c8eb8a-21a9-42cf-8ad6-4e8cba0adc9e tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:05:59.106062 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-58c8eb8a-21a9-42cf-8ad6-4e8cba0adc9e tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:00.285740 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-58c8eb8a-21a9-42cf-8ad6-4e8cba0adc9e tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "POST /compute/v2.1/servers/ec256177-0365-4a8e-af6c-56f68a6f9a54/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.193192 Jul 05 13:06:00.286386 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 335/665] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Jul 5 13:05:59 2022] POST /compute/v2.1/servers/ec256177-0365-4a8e-af6c-56f68a6f9a54/os-volume_attachments => generated 194 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:06:08.818419 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-3a617c17-0c17-408e-ae87-b40b0b88d2a0 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "35ac642d-fb08-43fc-b63f-4eaf22a96ca8"}} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:06:08.819486 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-3a617c17-0c17-408e-ae87-b40b0b88d2a0 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: ec256177-0365-4a8e-af6c-56f68a6f9a54] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:08.821459 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell1:SELECT=9 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:06:08.826513 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3a617c17-0c17-408e-ae87-b40b0b88d2a0 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:08.826973 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3a617c17-0c17-408e-ae87-b40b0b88d2a0 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:08.827737 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3a617c17-0c17-408e-ae87-b40b0b88d2a0 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:08.828174 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3a617c17-0c17-408e-ae87-b40b0b88d2a0 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:08.965818 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.wsgi [None req-3a617c17-0c17-408e-ae87-b40b0b88d2a0 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] HTTP exception thrown: Invalid volume: volume 35ac642d-fb08-43fc-b63f-4eaf22a96ca8 is already attached to instances: ec256177-0365-4a8e-af6c-56f68a6f9a54 Jul 05 13:06:08.967525 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-3a617c17-0c17-408e-ae87-b40b0b88d2a0 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Request method failure captured: Jul 05 13:06:08.967525 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: request: POST /compute/v2.1/servers/ec256177-0365-4a8e-af6c-56f68a6f9a54/os-volume_attachments HTTP/1.1 Jul 05 13:06:08.967525 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept: application/json Jul 05 13:06:08.967525 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept-Encoding: identity Jul 05 13:06:08.967525 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Connection: close Jul 05 13:06:08.967525 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Length: 74 Jul 05 13:06:08.967525 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Type: application/json Jul 05 13:06:08.967525 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Host: 10.222.0.36 Jul 05 13:06:08.967525 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Openstack-System-Scope: None Jul 05 13:06:08.967525 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: User-Agent: python-urllib3/1.26.9 Jul 05 13:06:08.967525 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Auth-Token: gAAAAABixDYWQWL8uJCqum4c6BlnNfbR703HW4HnpwW8iX1I1pbqlc_QGnJWLD1G-z_DKnfPJbbyyKcDC4sR005HdVrBcj6np6lEImplVRPpD09FwDfrBAC23lqXzO2ZdNTX7uxeDP3sMtbJ8KEd2t_ks3LspqcGELiRwc6BksJqjl4JxwirzAA Jul 05 13:06:08.967525 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Id: None Jul 05 13:06:08.967525 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Name: None Jul 05 13:06:08.967525 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Identity-Status: Confirmed Jul 05 13:06:08.967525 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Is-Admin-Project: True Jul 05 13:06:08.967525 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Id: default Jul 05 13:06:08.967525 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Name: Default Jul 05 13:06:08.967525 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Id: 163f0d5f47be49f493296f228d1080a5 Jul 05 13:06:08.967525 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Name: tempest-AttachVolumeNegativeTest-1554059375 Jul 05 13:06:08.967525 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Role: member,reader Jul 05 13:06:08.967525 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Roles: member,reader Jul 05 13:06:08.969141 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/163f0d5f47be49f493296f228d1080a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_163f0d5f47be49f493296f228d1080a5", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/163f0d5f47be49f493296f228d1080a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/163f0d5f47be49f493296f228d1080a5"}]}] Jul 05 13:06:08.969141 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant: tempest-AttachVolumeNegativeTest-1554059375 Jul 05 13:06:08.969141 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Id: 163f0d5f47be49f493296f228d1080a5 Jul 05 13:06:08.969141 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1554059375 Jul 05 13:06:08.969141 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User: tempest-AttachVolumeNegativeTest-1554059375-project Jul 05 13:06:08.969141 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Id: default Jul 05 13:06:08.969141 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Name: Default Jul 05 13:06:08.969141 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Id: aa97e27060b3429bbad061a256db19f1 Jul 05 13:06:08.969141 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Name: tempest-AttachVolumeNegativeTest-1554059375-project Jul 05 13:06:08.969141 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Jul 05 13:06:08.969141 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: {"volumeAttachment": {"volumeId": "35ac642d-fb08-43fc-b63f-4eaf22a96ca8"}} Jul 05 13:06:08.969141 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: method: > Jul 05 13:06:08.970055 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: exception: Invalid volume: volume 35ac642d-fb08-43fc-b63f-4eaf22a96ca8 is already attached to instances: ec256177-0365-4a8e-af6c-56f68a6f9a54 Jul 05 13:06:08.970055 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: action_args: {'server_id': 'ec256177-0365-4a8e-af6c-56f68a6f9a54', 'body': {'volumeAttachment': {'volumeId': '35ac642d-fb08-43fc-b63f-4eaf22a96ca8'}}} Jul 05 13:06:08.970055 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 13:06:08.970055 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:06:08.970055 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 05 13:06:08.970055 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 05 13:06:08.970055 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 05 13:06:08.970055 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 05 13:06:08.970055 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 05 13:06:08.970055 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 05 13:06:08.970055 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 05 13:06:08.970055 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 05 13:06:08.970055 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 05 13:06:08.970055 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 05 13:06:08.970055 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 35ac642d-fb08-43fc-b63f-4eaf22a96ca8 is already attached to instances: ec256177-0365-4a8e-af6c-56f68a6f9a54 Jul 05 13:06:08.970055 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:06:08.970055 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:06:08.970055 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:06:08.970055 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:06:08.971427 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:06:08.971427 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:06:08.971427 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 13:06:08.971427 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 13:06:08.971427 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 13:06:08.971427 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 13:06:08.971427 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 05 13:06:08.971427 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 05 13:06:08.971427 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 05 13:06:08.971427 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 05 13:06:08.971427 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 05 13:06:08.971427 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 05 13:06:08.971427 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 05 13:06:08.971427 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 05 13:06:08.971427 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 35ac642d-fb08-43fc-b63f-4eaf22a96ca8 is already attached to instances: ec256177-0365-4a8e-af6c-56f68a6f9a54 Jul 05 13:06:08.971427 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:06:08.971427 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:06:08.971427 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:06:08.971427 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:06:08.971427 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:06:08.972994 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:06:08.972994 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 13:06:08.972994 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 13:06:08.972994 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 35ac642d-fb08-43fc-b63f-4eaf22a96ca8 is already attached to instances: ec256177-0365-4a8e-af6c-56f68a6f9a54 Jul 05 13:06:08.972994 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:06:08.972994 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-3a617c17-0c17-408e-ae87-b40b0b88d2a0 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Returning 400 to user: Invalid volume: volume 35ac642d-fb08-43fc-b63f-4eaf22a96ca8 is already attached to instances: ec256177-0365-4a8e-af6c-56f68a6f9a54 {{(pid=118387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 13:06:08.972994 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-3a617c17-0c17-408e-ae87-b40b0b88d2a0 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "POST /compute/v2.1/servers/ec256177-0365-4a8e-af6c-56f68a6f9a54/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.155073 Jul 05 13:06:08.972994 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 331/666] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Jul 5 13:06:08 2022] POST /compute/v2.1/servers/ec256177-0365-4a8e-af6c-56f68a6f9a54/os-volume_attachments => generated 174 bytes in 156 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 05 13:06:09.030219 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-535aae05-8f75-45e2-9567-9fb3849078d8 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:09.030800 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-535aae05-8f75-45e2-9567-9fb3849078d8 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: ec256177-0365-4a8e-af6c-56f68a6f9a54] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:09.032734 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=35 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:06:09.037790 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-535aae05-8f75-45e2-9567-9fb3849078d8 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:09.038244 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-535aae05-8f75-45e2-9567-9fb3849078d8 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:09.039020 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-535aae05-8f75-45e2-9567-9fb3849078d8 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:09.039431 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-535aae05-8f75-45e2-9567-9fb3849078d8 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:09.118849 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.objects.instance [None req-535aae05-8f75-45e2-9567-9fb3849078d8 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lazy-loading 'services' on Instance uuid ec256177-0365-4a8e-af6c-56f68a6f9a54 {{(pid=118386) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 13:06:09.355893 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-535aae05-8f75-45e2-9567-9fb3849078d8 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ec256177-0365-4a8e-af6c-56f68a6f9a54/os-volume_attachments/35ac642d-fb08-43fc-b63f-4eaf22a96ca8" status: 202 len: 0 microversion: 2.1 time: 0.330344 Jul 05 13:06:09.356480 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 336/667] 10.222.0.36 () {58 vars in 1415 bytes} [Tue Jul 5 13:06:09 2022] DELETE /compute/v2.1/servers/ec256177-0365-4a8e-af6c-56f68a6f9a54/os-volume_attachments/35ac642d-fb08-43fc-b63f-4eaf22a96ca8 => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 13:06:09.364796 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-cb5e880b-9743-4d87-8635-f8be7ec1f7a0 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:09.376291 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-cb5e880b-9743-4d87-8635-f8be7ec1f7a0 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: ec256177-0365-4a8e-af6c-56f68a6f9a54] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:09.376291 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cb5e880b-9743-4d87-8635-f8be7ec1f7a0 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:09.376291 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cb5e880b-9743-4d87-8635-f8be7ec1f7a0 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:09.376291 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cb5e880b-9743-4d87-8635-f8be7ec1f7a0 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:09.377323 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cb5e880b-9743-4d87-8635-f8be7ec1f7a0 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:09.405073 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-cb5e880b-9743-4d87-8635-f8be7ec1f7a0 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/ec256177-0365-4a8e-af6c-56f68a6f9a54/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044030 Jul 05 13:06:09.405640 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 332/668] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jul 5 13:06:09 2022] GET /compute/v2.1/servers/ec256177-0365-4a8e-af6c-56f68a6f9a54/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:06:10.417785 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-198473d0-dd66-41e0-830d-6262ea1f63be tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:10.418865 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-198473d0-dd66-41e0-830d-6262ea1f63be tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: ec256177-0365-4a8e-af6c-56f68a6f9a54] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:10.424961 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-198473d0-dd66-41e0-830d-6262ea1f63be tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:10.425402 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-198473d0-dd66-41e0-830d-6262ea1f63be tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:10.426144 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-198473d0-dd66-41e0-830d-6262ea1f63be tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:10.426569 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-198473d0-dd66-41e0-830d-6262ea1f63be tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:10.459392 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-198473d0-dd66-41e0-830d-6262ea1f63be tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/ec256177-0365-4a8e-af6c-56f68a6f9a54/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047047 Jul 05 13:06:10.459938 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 337/669] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jul 5 13:06:10 2022] GET /compute/v2.1/servers/ec256177-0365-4a8e-af6c-56f68a6f9a54/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 05 13:06:10.516932 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-5e0be608-d1ea-4f78-88ae-7276594ca34e tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:10.517458 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-5e0be608-d1ea-4f78-88ae-7276594ca34e tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: ec256177-0365-4a8e-af6c-56f68a6f9a54] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:10.524418 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5e0be608-d1ea-4f78-88ae-7276594ca34e tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:10.524906 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5e0be608-d1ea-4f78-88ae-7276594ca34e tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:10.525665 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5e0be608-d1ea-4f78-88ae-7276594ca34e tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:10.526103 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5e0be608-d1ea-4f78-88ae-7276594ca34e tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:10.550312 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-5e0be608-d1ea-4f78-88ae-7276594ca34e tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: ec256177-0365-4a8e-af6c-56f68a6f9a54] Going to try to terminate instance {{(pid=118387) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 13:06:10.967021 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-5e0be608-d1ea-4f78-88ae-7276594ca34e tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ec256177-0365-4a8e-af6c-56f68a6f9a54" status: 204 len: 0 microversion: 2.1 time: 0.453571 Jul 05 13:06:10.967600 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 333/670] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jul 5 13:06:10 2022] DELETE /compute/v2.1/servers/ec256177-0365-4a8e-af6c-56f68a6f9a54 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 05 13:06:11.075851 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-44e47efc-37c6-4499-aa98-aef285f29051 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:11.076465 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-44e47efc-37c6-4499-aa98-aef285f29051 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: ec256177-0365-4a8e-af6c-56f68a6f9a54] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:11.082397 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-44e47efc-37c6-4499-aa98-aef285f29051 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:11.082837 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-44e47efc-37c6-4499-aa98-aef285f29051 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:11.083577 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-44e47efc-37c6-4499-aa98-aef285f29051 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:11.084000 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-44e47efc-37c6-4499-aa98-aef285f29051 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:11.213940 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-44e47efc-37c6-4499-aa98-aef285f29051 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:11.221400 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-44e47efc-37c6-4499-aa98-aef285f29051 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/ec256177-0365-4a8e-af6c-56f68a6f9a54" status: 200 len: 1682 microversion: 2.1 time: 0.249599 Jul 05 13:06:11.221958 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 338/671] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:06:10 2022] GET /compute/v2.1/servers/ec256177-0365-4a8e-af6c-56f68a6f9a54 => generated 1682 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:06:12.239835 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-47c39d64-9156-487c-b05d-b3bb3c143824 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:12.240469 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-47c39d64-9156-487c-b05d-b3bb3c143824 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: ec256177-0365-4a8e-af6c-56f68a6f9a54] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:12.247560 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-47c39d64-9156-487c-b05d-b3bb3c143824 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:12.248006 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-47c39d64-9156-487c-b05d-b3bb3c143824 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:12.248796 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-47c39d64-9156-487c-b05d-b3bb3c143824 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:12.249233 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-47c39d64-9156-487c-b05d-b3bb3c143824 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:12.377876 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-47c39d64-9156-487c-b05d-b3bb3c143824 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:12.385551 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-47c39d64-9156-487c-b05d-b3bb3c143824 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/ec256177-0365-4a8e-af6c-56f68a6f9a54" status: 200 len: 1682 microversion: 2.1 time: 0.150037 Jul 05 13:06:12.386116 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 334/672] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:06:12 2022] GET /compute/v2.1/servers/ec256177-0365-4a8e-af6c-56f68a6f9a54 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:06:13.402569 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-107aa1fe-904c-4612-bb5d-8532b2e6eba8 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:13.403176 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-107aa1fe-904c-4612-bb5d-8532b2e6eba8 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: ec256177-0365-4a8e-af6c-56f68a6f9a54] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:13.409700 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-107aa1fe-904c-4612-bb5d-8532b2e6eba8 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:13.410089 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-107aa1fe-904c-4612-bb5d-8532b2e6eba8 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:13.410859 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-107aa1fe-904c-4612-bb5d-8532b2e6eba8 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:13.411286 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-107aa1fe-904c-4612-bb5d-8532b2e6eba8 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:13.472537 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-107aa1fe-904c-4612-bb5d-8532b2e6eba8 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:13.480733 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-107aa1fe-904c-4612-bb5d-8532b2e6eba8 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/ec256177-0365-4a8e-af6c-56f68a6f9a54" status: 200 len: 1614 microversion: 2.1 time: 0.082063 Jul 05 13:06:13.481297 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 339/673] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:06:13 2022] GET /compute/v2.1/servers/ec256177-0365-4a8e-af6c-56f68a6f9a54 => generated 1614 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:06:13.635472 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-2325467d-58b9-4b03-abeb-edb097e81930 req-49efc831-ee0d-4031-9ed5-99639e49fdec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec256177-0365-4a8e-af6c-56f68a6f9a54", "name": "network-vif-deleted", "tag": "606c57ab-1e76-4fd5-a780-b78e616e251d"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:06:13.643396 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-2325467d-58b9-4b03-abeb-edb097e81930 req-49efc831-ee0d-4031-9ed5-99639e49fdec service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:13.643844 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-2325467d-58b9-4b03-abeb-edb097e81930 req-49efc831-ee0d-4031-9ed5-99639e49fdec service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:13.654930 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-2325467d-58b9-4b03-abeb-edb097e81930 req-49efc831-ee0d-4031-9ed5-99639e49fdec service nova] Creating event network-vif-deleted:606c57ab-1e76-4fd5-a780-b78e616e251d for instance ec256177-0365-4a8e-af6c-56f68a6f9a54 on hv-cinder-79760 Jul 05 13:06:13.659773 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-2325467d-58b9-4b03-abeb-edb097e81930 req-49efc831-ee0d-4031-9ed5-99639e49fdec service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028430 Jul 05 13:06:13.660446 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 335/674] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:06:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:06:14.497983 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-99fb5f91-f536-4050-817b-5b4ac358e9a1 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:14.498598 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-99fb5f91-f536-4050-817b-5b4ac358e9a1 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: ec256177-0365-4a8e-af6c-56f68a6f9a54] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:14.507481 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-99fb5f91-f536-4050-817b-5b4ac358e9a1 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:14.507930 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-99fb5f91-f536-4050-817b-5b4ac358e9a1 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:14.512751 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-99fb5f91-f536-4050-817b-5b4ac358e9a1 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:14.512751 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-99fb5f91-f536-4050-817b-5b4ac358e9a1 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:14.542269 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-99fb5f91-f536-4050-817b-5b4ac358e9a1 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:14.542715 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-99fb5f91-f536-4050-817b-5b4ac358e9a1 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:14.543166 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.objects.instance [None req-99fb5f91-f536-4050-817b-5b4ac358e9a1 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lazy-loading 'fault' on Instance uuid ec256177-0365-4a8e-af6c-56f68a6f9a54 {{(pid=118386) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 13:06:14.605759 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-99fb5f91-f536-4050-817b-5b4ac358e9a1 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:14.613402 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-99fb5f91-f536-4050-817b-5b4ac358e9a1 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/ec256177-0365-4a8e-af6c-56f68a6f9a54" status: 200 len: 1331 microversion: 2.1 time: 0.119238 Jul 05 13:06:14.613963 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 340/675] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:06:14 2022] GET /compute/v2.1/servers/ec256177-0365-4a8e-af6c-56f68a6f9a54 => generated 1331 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:06:15.631164 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-86d94308-3016-4fab-80b6-b92a5e13bb91 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:15.631899 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-86d94308-3016-4fab-80b6-b92a5e13bb91 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: ec256177-0365-4a8e-af6c-56f68a6f9a54] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:15.639069 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-86d94308-3016-4fab-80b6-b92a5e13bb91 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:15.639518 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-86d94308-3016-4fab-80b6-b92a5e13bb91 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:15.640283 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-86d94308-3016-4fab-80b6-b92a5e13bb91 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:15.640754 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-86d94308-3016-4fab-80b6-b92a5e13bb91 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:15.654033 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.wsgi [None req-86d94308-3016-4fab-80b6-b92a5e13bb91 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] HTTP exception thrown: Instance ec256177-0365-4a8e-af6c-56f68a6f9a54 could not be found. Jul 05 13:06:15.655653 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-86d94308-3016-4fab-80b6-b92a5e13bb91 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Request method failure captured: Jul 05 13:06:15.655653 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: request: GET /compute/v2.1/servers/ec256177-0365-4a8e-af6c-56f68a6f9a54 HTTP/1.1 Jul 05 13:06:15.655653 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept: application/json Jul 05 13:06:15.655653 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept-Encoding: identity Jul 05 13:06:15.655653 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Connection: close Jul 05 13:06:15.655653 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Length: 0 Jul 05 13:06:15.655653 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Type: application/json Jul 05 13:06:15.655653 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Host: 10.222.0.36 Jul 05 13:06:15.655653 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Openstack-System-Scope: None Jul 05 13:06:15.655653 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: User-Agent: python-urllib3/1.26.9 Jul 05 13:06:15.655653 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Auth-Token: gAAAAABixDYWQWL8uJCqum4c6BlnNfbR703HW4HnpwW8iX1I1pbqlc_QGnJWLD1G-z_DKnfPJbbyyKcDC4sR005HdVrBcj6np6lEImplVRPpD09FwDfrBAC23lqXzO2ZdNTX7uxeDP3sMtbJ8KEd2t_ks3LspqcGELiRwc6BksJqjl4JxwirzAA Jul 05 13:06:15.655653 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Id: None Jul 05 13:06:15.655653 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Name: None Jul 05 13:06:15.655653 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Identity-Status: Confirmed Jul 05 13:06:15.655653 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Is-Admin-Project: True Jul 05 13:06:15.655653 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Id: default Jul 05 13:06:15.655653 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Name: Default Jul 05 13:06:15.655653 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Id: 163f0d5f47be49f493296f228d1080a5 Jul 05 13:06:15.655653 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Name: tempest-AttachVolumeNegativeTest-1554059375 Jul 05 13:06:15.655653 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Role: member,reader Jul 05 13:06:15.655653 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Roles: member,reader Jul 05 13:06:15.657259 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/163f0d5f47be49f493296f228d1080a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_163f0d5f47be49f493296f228d1080a5", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/163f0d5f47be49f493296f228d1080a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/163f0d5f47be49f493296f228d1080a5"}]}] Jul 05 13:06:15.657259 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant: tempest-AttachVolumeNegativeTest-1554059375 Jul 05 13:06:15.657259 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Id: 163f0d5f47be49f493296f228d1080a5 Jul 05 13:06:15.657259 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1554059375 Jul 05 13:06:15.657259 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User: tempest-AttachVolumeNegativeTest-1554059375-project Jul 05 13:06:15.657259 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Id: default Jul 05 13:06:15.657259 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Name: Default Jul 05 13:06:15.657259 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Id: aa97e27060b3429bbad061a256db19f1 Jul 05 13:06:15.657259 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Name: tempest-AttachVolumeNegativeTest-1554059375-project Jul 05 13:06:15.657259 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: method: > Jul 05 13:06:15.657259 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: exception: Instance ec256177-0365-4a8e-af6c-56f68a6f9a54 could not be found. Jul 05 13:06:15.657259 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: action_args: {'id': 'ec256177-0365-4a8e-af6c-56f68a6f9a54'} Jul 05 13:06:15.658343 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 13:06:15.658343 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:06:15.658343 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 13:06:15.658343 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 13:06:15.658343 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 13:06:15.658343 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 13:06:15.658343 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 13:06:15.658343 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 13:06:15.658343 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 13:06:15.658343 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 13:06:15.658343 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec256177-0365-4a8e-af6c-56f68a6f9a54 could not be found. Jul 05 13:06:15.658343 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:06:15.658343 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:06:15.658343 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:06:15.658343 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:06:15.658343 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:06:15.658343 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:06:15.658343 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 13:06:15.658343 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 13:06:15.658343 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 13:06:15.660034 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 13:06:15.660034 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 13:06:15.660034 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 13:06:15.660034 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 13:06:15.660034 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 13:06:15.660034 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 13:06:15.660034 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 13:06:15.660034 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec256177-0365-4a8e-af6c-56f68a6f9a54 could not be found. Jul 05 13:06:15.660034 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:06:15.660034 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:06:15.660034 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:06:15.660034 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:06:15.660034 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:06:15.660034 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:06:15.660034 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 13:06:15.660034 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 13:06:15.660034 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec256177-0365-4a8e-af6c-56f68a6f9a54 could not be found. Jul 05 13:06:15.660034 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:06:15.661330 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-86d94308-3016-4fab-80b6-b92a5e13bb91 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Returning 404 to user: Instance ec256177-0365-4a8e-af6c-56f68a6f9a54 could not be found. {{(pid=118387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 13:06:15.661330 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-86d94308-3016-4fab-80b6-b92a5e13bb91 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/ec256177-0365-4a8e-af6c-56f68a6f9a54" status: 404 len: 111 microversion: 2.1 time: 0.030616 Jul 05 13:06:15.661330 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 336/676] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:06:15 2022] GET /compute/v2.1/servers/ec256177-0365-4a8e-af6c-56f68a6f9a54 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 13:06:15.666417 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-82a73493-8b69-460b-ad76-ef83374c607d tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '.version_select at 0x7f70de6bd280>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:15.722354 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-82a73493-8b69-460b-ad76-ef83374c607d tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1735513436" status: 202 len: 0 microversion: 2.1 time: 0.060150 Jul 05 13:06:15.722845 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 341/677] 10.222.0.36 () {58 vars in 1220 bytes} [Tue Jul 5 13:06:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1735513436 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 13:06:16.469858 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-58c8e3d5-210f-42f5-9014-7d5f2a137978 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Action: 'create', calling method: .version_select at 0x7f70de59f160>, body: {"keypair": {"name": "tempest-keypair-1866201714", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDvjh7a32EwjSsPLERLCxAdaBiZw6VvCItxKIJqOu9U0gEyRRKzAcDGh9M/wnNbdwyyacUaHr/iO1vk6ZG3FL5sCgvyMJU/2fA5rXAAFMnrEyIHKaJFepxKrAuJhScaLGw=="}} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:06:16.484489 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.quota [None req-58c8e3d5-210f-42f5-9014-7d5f2a137978 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Getting quotas for project 163f0d5f47be49f493296f228d1080a5. Resources: {'key_pairs'} {{(pid=118387) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 13:06:16.488305 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.quota [None req-58c8e3d5-210f-42f5-9014-7d5f2a137978 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Getting quotas for user aa97e27060b3429bbad061a256db19f1 and project 163f0d5f47be49f493296f228d1080a5. Resources: {'key_pairs'} {{(pid=118387) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 13:06:16.568635 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-58c8e3d5-210f-42f5-9014-7d5f2a137978 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.102568 Jul 05 13:06:16.569218 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 337/678] 10.222.0.36 () {60 vars in 1158 bytes} [Tue Jul 5 13:06:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:06:18.861925 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-89dd6769-2377-4ce5-b8eb-f9e08e27447f tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-733728008", "imageRef": "d6134305-a5c0-4d2c-afc8-e54be21f685c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3aaa0da9-0f6f-4fc6-8a51-4d7d6726eda8"}], "security_groups": [{"name": "tempest-securitygroup--1278829384"}], "key_name": "tempest-keypair-1866201714", "user_data": "}} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:06:18.960930 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.network.neutron [None req-89dd6769-2377-4ce5-b8eb-f9e08e27447f tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] validate_networks() for [('3aaa0da9-0f6f-4fc6-8a51-4d7d6726eda8', None, None, None, None, None)] {{(pid=118386) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 13:06:19.416685 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.virt.hardware [None req-89dd6769-2377-4ce5-b8eb-f9e08e27447f tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Flavor limits 0:0:0 {{(pid=118386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 13:06:19.417117 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.virt.hardware [None req-89dd6769-2377-4ce5-b8eb-f9e08e27447f tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Image limits 0:0:0 {{(pid=118386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 13:06:19.417587 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.virt.hardware [None req-89dd6769-2377-4ce5-b8eb-f9e08e27447f tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Flavor pref 0:0:0 {{(pid=118386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 13:06:19.417992 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.virt.hardware [None req-89dd6769-2377-4ce5-b8eb-f9e08e27447f tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Image pref 0:0:0 {{(pid=118386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 13:06:19.418401 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.virt.hardware [None req-89dd6769-2377-4ce5-b8eb-f9e08e27447f tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 13:06:19.427171 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-89dd6769-2377-4ce5-b8eb-f9e08e27447f tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:19.427618 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-89dd6769-2377-4ce5-b8eb-f9e08e27447f tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:19.428406 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-89dd6769-2377-4ce5-b8eb-f9e08e27447f tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:19.428895 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-89dd6769-2377-4ce5-b8eb-f9e08e27447f tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:19.445969 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.quota [None req-89dd6769-2377-4ce5-b8eb-f9e08e27447f tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Getting quotas for project 163f0d5f47be49f493296f228d1080a5. Resources: {'instances', 'cores', 'ram'} {{(pid=118386) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 13:06:19.449904 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.quota [None req-89dd6769-2377-4ce5-b8eb-f9e08e27447f tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Getting quotas for user aa97e27060b3429bbad061a256db19f1 and project 163f0d5f47be49f493296f228d1080a5. Resources: {'instances', 'cores', 'ram'} {{(pid=118386) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 13:06:19.461539 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-89dd6769-2377-4ce5-b8eb-f9e08e27447f tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Going to run 1 instances... {{(pid=118386) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 13:06:19.464147 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-89dd6769-2377-4ce5-b8eb-f9e08e27447f tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 4c6520f9-4cce-44f6-a004-5226841dd52a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d6134305-a5c0-4d2c-afc8-e54be21f685c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118386) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 13:06:19.575397 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-89dd6769-2377-4ce5-b8eb-f9e08e27447f tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.718117 Jul 05 13:06:19.581084 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 342/679] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jul 5 13:06:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 05 13:06:19.591483 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-8c00c0d0-f828-4b38-abbc-c58de7068914 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:19.592138 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-8c00c0d0-f828-4b38-abbc-c58de7068914 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 4c6520f9-4cce-44f6-a004-5226841dd52a] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:19.650286 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-8c00c0d0-f828-4b38-abbc-c58de7068914 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:19.657007 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-8c00c0d0-f828-4b38-abbc-c58de7068914 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/4c6520f9-4cce-44f6-a004-5226841dd52a" status: 200 len: 1241 microversion: 2.1 time: 0.074481 Jul 05 13:06:19.657559 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 338/680] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:06:19 2022] GET /compute/v2.1/servers/4c6520f9-4cce-44f6-a004-5226841dd52a => generated 1241 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:06:20.464238 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-3f8776bf-cb47-4fae-a517-12c3004c7423 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:20.464782 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-3f8776bf-cb47-4fae-a517-12c3004c7423 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 7b7f15b2-a00e-4172-983d-f2a80401953b] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:20.471316 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-3f8776bf-cb47-4fae-a517-12c3004c7423 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:20.471763 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-3f8776bf-cb47-4fae-a517-12c3004c7423 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:20.472575 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-3f8776bf-cb47-4fae-a517-12c3004c7423 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:20.472969 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-3f8776bf-cb47-4fae-a517-12c3004c7423 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:20.556576 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.objects.instance [None req-3f8776bf-cb47-4fae-a517-12c3004c7423 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lazy-loading 'services' on Instance uuid 7b7f15b2-a00e-4172-983d-f2a80401953b {{(pid=118386) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 13:06:20.674152 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-cfcd1d44-0401-43f0-a9f4-50926ed523c4 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:20.674759 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-cfcd1d44-0401-43f0-a9f4-50926ed523c4 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 4c6520f9-4cce-44f6-a004-5226841dd52a] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:20.681392 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cfcd1d44-0401-43f0-a9f4-50926ed523c4 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:20.681836 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cfcd1d44-0401-43f0-a9f4-50926ed523c4 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:20.682593 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cfcd1d44-0401-43f0-a9f4-50926ed523c4 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:20.683074 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cfcd1d44-0401-43f0-a9f4-50926ed523c4 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:20.748495 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-cfcd1d44-0401-43f0-a9f4-50926ed523c4 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:20.756024 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-cfcd1d44-0401-43f0-a9f4-50926ed523c4 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/4c6520f9-4cce-44f6-a004-5226841dd52a" status: 200 len: 1245 microversion: 2.1 time: 0.085742 Jul 05 13:06:20.756627 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 339/681] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:06:20 2022] GET /compute/v2.1/servers/4c6520f9-4cce-44f6-a004-5226841dd52a => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:06:20.841955 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-3f8776bf-cb47-4fae-a517-12c3004c7423 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "DELETE /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b/os-volume_attachments/055e4eb6-4954-4d2b-b41a-8a296f54ac26" status: 202 len: 0 microversion: 2.1 time: 0.381061 Jul 05 13:06:20.842581 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 343/682] 10.222.0.36 () {58 vars in 1415 bytes} [Tue Jul 5 13:06:20 2022] DELETE /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b/os-volume_attachments/055e4eb6-4954-4d2b-b41a-8a296f54ac26 => generated 0 bytes in 383 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 13:06:20.852050 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-d9811662-9cd5-4819-8444-976084d6184a tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:20.853045 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-d9811662-9cd5-4819-8444-976084d6184a tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 7b7f15b2-a00e-4172-983d-f2a80401953b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:20.859458 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d9811662-9cd5-4819-8444-976084d6184a tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:20.859803 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d9811662-9cd5-4819-8444-976084d6184a tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:20.860566 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d9811662-9cd5-4819-8444-976084d6184a tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:20.861020 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d9811662-9cd5-4819-8444-976084d6184a tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:20.889475 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-d9811662-9cd5-4819-8444-976084d6184a tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042620 Jul 05 13:06:20.890018 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 340/683] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jul 5 13:06:20 2022] GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:06:21.773806 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-2f4ff23b-21bc-494e-9a92-bb035f7a4326 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:21.774523 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-2f4ff23b-21bc-494e-9a92-bb035f7a4326 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 4c6520f9-4cce-44f6-a004-5226841dd52a] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:21.781403 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-2f4ff23b-21bc-494e-9a92-bb035f7a4326 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:21.782188 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-2f4ff23b-21bc-494e-9a92-bb035f7a4326 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:21.782597 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-2f4ff23b-21bc-494e-9a92-bb035f7a4326 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:21.783026 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-2f4ff23b-21bc-494e-9a92-bb035f7a4326 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:21.785826 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:06:21.848075 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-2f4ff23b-21bc-494e-9a92-bb035f7a4326 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:21.855827 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-2f4ff23b-21bc-494e-9a92-bb035f7a4326 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/4c6520f9-4cce-44f6-a004-5226841dd52a" status: 200 len: 1293 microversion: 2.1 time: 0.087001 Jul 05 13:06:21.856408 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 344/684] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:06:21 2022] GET /compute/v2.1/servers/4c6520f9-4cce-44f6-a004-5226841dd52a => generated 1293 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:06:21.902253 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-cb8f67d0-75f4-41d1-bbde-01826cae8fdc tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:21.903197 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-cb8f67d0-75f4-41d1-bbde-01826cae8fdc tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 7b7f15b2-a00e-4172-983d-f2a80401953b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:21.909912 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cb8f67d0-75f4-41d1-bbde-01826cae8fdc tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:21.910363 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cb8f67d0-75f4-41d1-bbde-01826cae8fdc tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:21.911127 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cb8f67d0-75f4-41d1-bbde-01826cae8fdc tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:21.911565 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cb8f67d0-75f4-41d1-bbde-01826cae8fdc tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:21.940739 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-cb8f67d0-75f4-41d1-bbde-01826cae8fdc tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043336 Jul 05 13:06:21.941303 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 341/685] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jul 5 13:06:21 2022] GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:06:22.872981 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-7bc649b0-05ea-49fe-9137-84c90f25bdfd tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:22.873596 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-7bc649b0-05ea-49fe-9137-84c90f25bdfd tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 4c6520f9-4cce-44f6-a004-5226841dd52a] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:22.880929 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-7bc649b0-05ea-49fe-9137-84c90f25bdfd tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:22.883646 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-7bc649b0-05ea-49fe-9137-84c90f25bdfd tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:22.883646 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-7bc649b0-05ea-49fe-9137-84c90f25bdfd tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:22.883646 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-7bc649b0-05ea-49fe-9137-84c90f25bdfd tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:22.952878 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-9f8e2a73-0c1b-4fcd-88d6-be39804603bb tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:22.953840 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-9f8e2a73-0c1b-4fcd-88d6-be39804603bb tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 7b7f15b2-a00e-4172-983d-f2a80401953b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:22.965930 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9f8e2a73-0c1b-4fcd-88d6-be39804603bb tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:22.966509 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9f8e2a73-0c1b-4fcd-88d6-be39804603bb tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:22.967479 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9f8e2a73-0c1b-4fcd-88d6-be39804603bb tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:22.968393 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9f8e2a73-0c1b-4fcd-88d6-be39804603bb tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:23.005497 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-9f8e2a73-0c1b-4fcd-88d6-be39804603bb tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056822 Jul 05 13:06:23.010509 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 342/686] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jul 5 13:06:22 2022] GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 05 13:06:23.029796 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-7bc649b0-05ea-49fe-9137-84c90f25bdfd tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:23.039304 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-7bc649b0-05ea-49fe-9137-84c90f25bdfd tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/4c6520f9-4cce-44f6-a004-5226841dd52a" status: 200 len: 1367 microversion: 2.1 time: 0.169239 Jul 05 13:06:23.039590 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 345/687] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:06:22 2022] GET /compute/v2.1/servers/4c6520f9-4cce-44f6-a004-5226841dd52a => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:06:23.101841 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-a9271dc8-b44f-4b63-afa8-6cc8d0c97dc4 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:23.102420 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-a9271dc8-b44f-4b63-afa8-6cc8d0c97dc4 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 7b7f15b2-a00e-4172-983d-f2a80401953b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:23.109334 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a9271dc8-b44f-4b63-afa8-6cc8d0c97dc4 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:23.109883 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a9271dc8-b44f-4b63-afa8-6cc8d0c97dc4 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:23.110723 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a9271dc8-b44f-4b63-afa8-6cc8d0c97dc4 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:23.111213 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a9271dc8-b44f-4b63-afa8-6cc8d0c97dc4 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:23.138252 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-a9271dc8-b44f-4b63-afa8-6cc8d0c97dc4 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 7b7f15b2-a00e-4172-983d-f2a80401953b] Going to try to terminate instance {{(pid=118387) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 13:06:23.407475 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-a9271dc8-b44f-4b63-afa8-6cc8d0c97dc4 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "DELETE /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b" status: 204 len: 0 microversion: 2.1 time: 0.311233 Jul 05 13:06:23.408065 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 343/688] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jul 5 13:06:23 2022] DELETE /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 05 13:06:23.416643 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-67750f82-7774-4dde-86e0-258620fd6726 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:23.417854 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-67750f82-7774-4dde-86e0-258620fd6726 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 7b7f15b2-a00e-4172-983d-f2a80401953b] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:23.425536 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-67750f82-7774-4dde-86e0-258620fd6726 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:23.425978 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-67750f82-7774-4dde-86e0-258620fd6726 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:23.426752 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-67750f82-7774-4dde-86e0-258620fd6726 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:23.427184 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-67750f82-7774-4dde-86e0-258620fd6726 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:23.569783 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-67750f82-7774-4dde-86e0-258620fd6726 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:23.579900 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-67750f82-7774-4dde-86e0-258620fd6726 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b" status: 200 len: 1689 microversion: 2.1 time: 0.167415 Jul 05 13:06:23.590482 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 346/689] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:06:23 2022] GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b => generated 1689 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:06:23.936978 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-2e8aabad-4bc2-4087-86eb-0b71a9249046 req-cf14013b-e72f-4e47-8e55-19d0161db879 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c6520f9-4cce-44f6-a004-5226841dd52a", "tag": "0c693613-12ee-4f41-b9c6-7821cfee92f4"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:06:23.945139 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-2e8aabad-4bc2-4087-86eb-0b71a9249046 req-cf14013b-e72f-4e47-8e55-19d0161db879 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:23.945588 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-2e8aabad-4bc2-4087-86eb-0b71a9249046 req-cf14013b-e72f-4e47-8e55-19d0161db879 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:23.957223 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-2e8aabad-4bc2-4087-86eb-0b71a9249046 req-cf14013b-e72f-4e47-8e55-19d0161db879 service nova] Creating event network-changed:0c693613-12ee-4f41-b9c6-7821cfee92f4 for instance 4c6520f9-4cce-44f6-a004-5226841dd52a on hv-cinder-79760 Jul 05 13:06:23.962036 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-2e8aabad-4bc2-4087-86eb-0b71a9249046 req-cf14013b-e72f-4e47-8e55-19d0161db879 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029502 Jul 05 13:06:23.968327 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 344/690] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:06:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:06:24.055785 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-1ebba074-dab8-4fc2-90c1-1826999bcff3 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:24.056493 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-1ebba074-dab8-4fc2-90c1-1826999bcff3 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 4c6520f9-4cce-44f6-a004-5226841dd52a] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:24.063279 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-1ebba074-dab8-4fc2-90c1-1826999bcff3 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:24.063718 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-1ebba074-dab8-4fc2-90c1-1826999bcff3 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:24.064482 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-1ebba074-dab8-4fc2-90c1-1826999bcff3 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:24.065113 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-1ebba074-dab8-4fc2-90c1-1826999bcff3 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:24.194013 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-1ebba074-dab8-4fc2-90c1-1826999bcff3 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:24.201634 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-1ebba074-dab8-4fc2-90c1-1826999bcff3 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/4c6520f9-4cce-44f6-a004-5226841dd52a" status: 200 len: 1367 microversion: 2.1 time: 0.150250 Jul 05 13:06:24.202206 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 347/691] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:06:24 2022] GET /compute/v2.1/servers/4c6520f9-4cce-44f6-a004-5226841dd52a => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:06:24.598776 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-3371c205-032c-4c15-a810-78108eb32bb8 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:24.599892 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-3371c205-032c-4c15-a810-78108eb32bb8 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 7b7f15b2-a00e-4172-983d-f2a80401953b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:24.606916 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3371c205-032c-4c15-a810-78108eb32bb8 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:24.607360 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3371c205-032c-4c15-a810-78108eb32bb8 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:24.608115 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3371c205-032c-4c15-a810-78108eb32bb8 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:24.608573 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3371c205-032c-4c15-a810-78108eb32bb8 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:24.743964 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-3371c205-032c-4c15-a810-78108eb32bb8 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:24.751350 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-3371c205-032c-4c15-a810-78108eb32bb8 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b" status: 200 len: 1689 microversion: 2.1 time: 0.156886 Jul 05 13:06:24.751913 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 345/692] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:06:24 2022] GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:06:25.217999 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-ce33bc10-f534-491e-9ff4-369a4bd566f0 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:25.218629 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-ce33bc10-f534-491e-9ff4-369a4bd566f0 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 4c6520f9-4cce-44f6-a004-5226841dd52a] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:25.225060 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ce33bc10-f534-491e-9ff4-369a4bd566f0 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:25.225500 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ce33bc10-f534-491e-9ff4-369a4bd566f0 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:25.226247 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ce33bc10-f534-491e-9ff4-369a4bd566f0 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:25.226672 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ce33bc10-f534-491e-9ff4-369a4bd566f0 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:25.350820 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-ce33bc10-f534-491e-9ff4-369a4bd566f0 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:25.358268 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-ce33bc10-f534-491e-9ff4-369a4bd566f0 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/4c6520f9-4cce-44f6-a004-5226841dd52a" status: 200 len: 1367 microversion: 2.1 time: 0.144061 Jul 05 13:06:25.358824 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 348/693] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:06:25 2022] GET /compute/v2.1/servers/4c6520f9-4cce-44f6-a004-5226841dd52a => generated 1367 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:06:25.768986 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-f9b2c4e9-65c9-4625-b218-690dc2b290f1 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:25.769528 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-f9b2c4e9-65c9-4625-b218-690dc2b290f1 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 7b7f15b2-a00e-4172-983d-f2a80401953b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:25.776177 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f9b2c4e9-65c9-4625-b218-690dc2b290f1 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:25.776651 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f9b2c4e9-65c9-4625-b218-690dc2b290f1 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:25.777406 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f9b2c4e9-65c9-4625-b218-690dc2b290f1 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:25.777835 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f9b2c4e9-65c9-4625-b218-690dc2b290f1 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:25.903466 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-f9b2c4e9-65c9-4625-b218-690dc2b290f1 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:25.910835 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-f9b2c4e9-65c9-4625-b218-690dc2b290f1 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b" status: 200 len: 1689 microversion: 2.1 time: 0.145838 Jul 05 13:06:25.911387 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 346/694] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:06:25 2022] GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b => generated 1689 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:06:26.375268 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-8b84ea3d-2f05-4ca5-ae9c-cd0b0da7123e tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:26.375808 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-8b84ea3d-2f05-4ca5-ae9c-cd0b0da7123e tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 4c6520f9-4cce-44f6-a004-5226841dd52a] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:26.382759 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-8b84ea3d-2f05-4ca5-ae9c-cd0b0da7123e tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:26.383204 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-8b84ea3d-2f05-4ca5-ae9c-cd0b0da7123e tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:26.383964 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-8b84ea3d-2f05-4ca5-ae9c-cd0b0da7123e tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:26.384396 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-8b84ea3d-2f05-4ca5-ae9c-cd0b0da7123e tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:26.511659 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-8b84ea3d-2f05-4ca5-ae9c-cd0b0da7123e tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:26.518959 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-8b84ea3d-2f05-4ca5-ae9c-cd0b0da7123e tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/4c6520f9-4cce-44f6-a004-5226841dd52a" status: 200 len: 1367 microversion: 2.1 time: 0.147635 Jul 05 13:06:26.519520 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 349/695] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:06:26 2022] GET /compute/v2.1/servers/4c6520f9-4cce-44f6-a004-5226841dd52a => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:06:26.927793 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-d8aa0263-32b5-48f3-9885-b9fa12067835 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:26.929193 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-d8aa0263-32b5-48f3-9885-b9fa12067835 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 7b7f15b2-a00e-4172-983d-f2a80401953b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:26.936084 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d8aa0263-32b5-48f3-9885-b9fa12067835 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:26.936636 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d8aa0263-32b5-48f3-9885-b9fa12067835 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:26.937870 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d8aa0263-32b5-48f3-9885-b9fa12067835 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:26.937870 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d8aa0263-32b5-48f3-9885-b9fa12067835 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:27.069969 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-d8aa0263-32b5-48f3-9885-b9fa12067835 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:27.077614 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-d8aa0263-32b5-48f3-9885-b9fa12067835 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b" status: 200 len: 1689 microversion: 2.1 time: 0.153791 Jul 05 13:06:27.078177 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 347/696] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:06:26 2022] GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b => generated 1689 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:06:27.535899 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-75500465-18cb-4542-b0fe-0822c25a8de6 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:27.540113 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-75500465-18cb-4542-b0fe-0822c25a8de6 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 4c6520f9-4cce-44f6-a004-5226841dd52a] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:27.543341 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-75500465-18cb-4542-b0fe-0822c25a8de6 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:27.543789 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-75500465-18cb-4542-b0fe-0822c25a8de6 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:27.544552 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-75500465-18cb-4542-b0fe-0822c25a8de6 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:27.545006 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-75500465-18cb-4542-b0fe-0822c25a8de6 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:27.688198 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-75500465-18cb-4542-b0fe-0822c25a8de6 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:27.696246 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-75500465-18cb-4542-b0fe-0822c25a8de6 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/4c6520f9-4cce-44f6-a004-5226841dd52a" status: 200 len: 1367 microversion: 2.1 time: 0.164287 Jul 05 13:06:27.696925 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 350/697] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:06:27 2022] GET /compute/v2.1/servers/4c6520f9-4cce-44f6-a004-5226841dd52a => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:06:28.094894 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-3b21b4e9-6d58-4834-b72d-2656a9894383 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:28.097749 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-3b21b4e9-6d58-4834-b72d-2656a9894383 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 7b7f15b2-a00e-4172-983d-f2a80401953b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:28.102728 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3b21b4e9-6d58-4834-b72d-2656a9894383 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:28.103169 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3b21b4e9-6d58-4834-b72d-2656a9894383 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:28.103950 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3b21b4e9-6d58-4834-b72d-2656a9894383 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:28.104740 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3b21b4e9-6d58-4834-b72d-2656a9894383 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:28.109034 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:06:28.249755 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-3b21b4e9-6d58-4834-b72d-2656a9894383 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:28.258919 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-3b21b4e9-6d58-4834-b72d-2656a9894383 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b" status: 200 len: 1689 microversion: 2.1 time: 0.167862 Jul 05 13:06:28.259478 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 348/698] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:06:28 2022] GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b => generated 1689 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:06:28.638061 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [req-efb9260e-077f-4b77-a86d-056c58c150d3 req-04132ece-5f0c-4713-bc43-bd11f459cfc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b7f15b2-a00e-4172-983d-f2a80401953b", "name": "network-vif-deleted", "tag": "31d1ed43-9fb9-4a56-aa9d-2fb0657cefdc"}]} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:06:28.646520 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-efb9260e-077f-4b77-a86d-056c58c150d3 req-04132ece-5f0c-4713-bc43-bd11f459cfc0 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:28.646970 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-efb9260e-077f-4b77-a86d-056c58c150d3 req-04132ece-5f0c-4713-bc43-bd11f459cfc0 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:28.659193 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.compute.server_external_events [req-efb9260e-077f-4b77-a86d-056c58c150d3 req-04132ece-5f0c-4713-bc43-bd11f459cfc0 service nova] Creating event network-vif-deleted:31d1ed43-9fb9-4a56-aa9d-2fb0657cefdc for instance 7b7f15b2-a00e-4172-983d-f2a80401953b on hv-cinder-79760 Jul 05 13:06:28.664280 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [req-efb9260e-077f-4b77-a86d-056c58c150d3 req-04132ece-5f0c-4713-bc43-bd11f459cfc0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029928 Jul 05 13:06:28.664911 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 351/699] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:06:28.714552 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-c1d12feb-6ab6-4ef8-bf1e-12505e6ec798 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:28.715204 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-c1d12feb-6ab6-4ef8-bf1e-12505e6ec798 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 4c6520f9-4cce-44f6-a004-5226841dd52a] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:28.722787 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c1d12feb-6ab6-4ef8-bf1e-12505e6ec798 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:28.723237 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c1d12feb-6ab6-4ef8-bf1e-12505e6ec798 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:28.726565 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c1d12feb-6ab6-4ef8-bf1e-12505e6ec798 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:28.726565 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c1d12feb-6ab6-4ef8-bf1e-12505e6ec798 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:28.881239 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-c1d12feb-6ab6-4ef8-bf1e-12505e6ec798 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:28.889988 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-c1d12feb-6ab6-4ef8-bf1e-12505e6ec798 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/4c6520f9-4cce-44f6-a004-5226841dd52a" status: 200 len: 1367 microversion: 2.1 time: 0.180369 Jul 05 13:06:28.891047 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 349/700] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:06:28 2022] GET /compute/v2.1/servers/4c6520f9-4cce-44f6-a004-5226841dd52a => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:06:28.953608 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-24602b4c-3f18-4297-89da-66b6fc5e708c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:28.954235 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-24602b4c-3f18-4297-89da-66b6fc5e708c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:28.960462 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-24602b4c-3f18-4297-89da-66b6fc5e708c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:28.960945 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-24602b4c-3f18-4297-89da-66b6fc5e708c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:28.961715 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-24602b4c-3f18-4297-89da-66b6fc5e708c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:28.962145 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-24602b4c-3f18-4297-89da-66b6fc5e708c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:28.985462 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-24602b4c-3f18-4297-89da-66b6fc5e708c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356/ips" status: 200 len: 152 microversion: 2.20 time: 0.154198 Jul 05 13:06:28.986020 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 352/701] 10.222.0.36 () {60 vars in 1288 bytes} [Tue Jul 5 13:06:28 2022] GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356/ips => generated 152 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 13:06:29.276193 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-82a8513d-7458-4a8b-af4e-b151e04c87f9 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:29.276939 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-82a8513d-7458-4a8b-af4e-b151e04c87f9 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 7b7f15b2-a00e-4172-983d-f2a80401953b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:29.283049 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-82a8513d-7458-4a8b-af4e-b151e04c87f9 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:29.284179 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-82a8513d-7458-4a8b-af4e-b151e04c87f9 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:29.284373 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-82a8513d-7458-4a8b-af4e-b151e04c87f9 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:29.284852 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-82a8513d-7458-4a8b-af4e-b151e04c87f9 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:29.358316 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-82a8513d-7458-4a8b-af4e-b151e04c87f9 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:29.369475 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-82a8513d-7458-4a8b-af4e-b151e04c87f9 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b" status: 200 len: 1621 microversion: 2.1 time: 0.097756 Jul 05 13:06:29.375395 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 350/702] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:06:29 2022] GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b => generated 1621 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:06:29.907086 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-6bcf5bfb-c87e-4248-8b95-94022f431d5a tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:29.907747 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-6bcf5bfb-c87e-4248-8b95-94022f431d5a tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 4c6520f9-4cce-44f6-a004-5226841dd52a] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:29.910243 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_cell0:SELECT=2 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:06:29.910903 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_cell0:SELECT=6 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:06:29.916784 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-6bcf5bfb-c87e-4248-8b95-94022f431d5a tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:29.917236 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-6bcf5bfb-c87e-4248-8b95-94022f431d5a tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:29.918036 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-6bcf5bfb-c87e-4248-8b95-94022f431d5a tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:29.918508 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-6bcf5bfb-c87e-4248-8b95-94022f431d5a tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:30.051813 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-6bcf5bfb-c87e-4248-8b95-94022f431d5a tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:30.059803 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-6bcf5bfb-c87e-4248-8b95-94022f431d5a tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/4c6520f9-4cce-44f6-a004-5226841dd52a" status: 200 len: 1367 microversion: 2.1 time: 0.156638 Jul 05 13:06:30.060527 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 353/703] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:06:29 2022] GET /compute/v2.1/servers/4c6520f9-4cce-44f6-a004-5226841dd52a => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:06:30.387171 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-68bf9f81-0382-4b96-90c2-a4b70383c5e0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:30.387786 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-68bf9f81-0382-4b96-90c2-a4b70383c5e0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 7b7f15b2-a00e-4172-983d-f2a80401953b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:30.389783 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell0:SELECT=6 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:06:30.395460 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-68bf9f81-0382-4b96-90c2-a4b70383c5e0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:30.395946 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-68bf9f81-0382-4b96-90c2-a4b70383c5e0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:30.396736 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-68bf9f81-0382-4b96-90c2-a4b70383c5e0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:30.397720 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-68bf9f81-0382-4b96-90c2-a4b70383c5e0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:30.433998 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-68bf9f81-0382-4b96-90c2-a4b70383c5e0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:30.434360 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-68bf9f81-0382-4b96-90c2-a4b70383c5e0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:30.435031 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.objects.instance [None req-68bf9f81-0382-4b96-90c2-a4b70383c5e0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lazy-loading 'fault' on Instance uuid 7b7f15b2-a00e-4172-983d-f2a80401953b {{(pid=118387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 13:06:30.479597 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-68bf9f81-0382-4b96-90c2-a4b70383c5e0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:30.487512 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-68bf9f81-0382-4b96-90c2-a4b70383c5e0 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b" status: 200 len: 1335 microversion: 2.1 time: 0.103904 Jul 05 13:06:30.487794 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 351/704] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:06:30 2022] GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b => generated 1335 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:06:31.077412 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-a2191036-0320-46cc-9815-51933d1e48fb tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:31.078028 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-a2191036-0320-46cc-9815-51933d1e48fb tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 4c6520f9-4cce-44f6-a004-5226841dd52a] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:31.085785 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a2191036-0320-46cc-9815-51933d1e48fb tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:31.086294 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a2191036-0320-46cc-9815-51933d1e48fb tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:31.087124 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a2191036-0320-46cc-9815-51933d1e48fb tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:31.087600 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a2191036-0320-46cc-9815-51933d1e48fb tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:31.218777 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-a2191036-0320-46cc-9815-51933d1e48fb tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:31.226188 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-a2191036-0320-46cc-9815-51933d1e48fb tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/4c6520f9-4cce-44f6-a004-5226841dd52a" status: 200 len: 1367 microversion: 2.1 time: 0.152561 Jul 05 13:06:31.226757 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 354/705] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:06:31 2022] GET /compute/v2.1/servers/4c6520f9-4cce-44f6-a004-5226841dd52a => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:06:31.512402 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-d4f26d36-4dfd-4822-ab59-ef94df9416e6 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:31.512991 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-d4f26d36-4dfd-4822-ab59-ef94df9416e6 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 7b7f15b2-a00e-4172-983d-f2a80401953b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:31.520613 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d4f26d36-4dfd-4822-ab59-ef94df9416e6 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:31.521083 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d4f26d36-4dfd-4822-ab59-ef94df9416e6 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:31.521893 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d4f26d36-4dfd-4822-ab59-ef94df9416e6 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:31.522351 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d4f26d36-4dfd-4822-ab59-ef94df9416e6 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:31.536466 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.wsgi [None req-d4f26d36-4dfd-4822-ab59-ef94df9416e6 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] HTTP exception thrown: Instance 7b7f15b2-a00e-4172-983d-f2a80401953b could not be found. Jul 05 13:06:31.538217 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-d4f26d36-4dfd-4822-ab59-ef94df9416e6 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Request method failure captured: Jul 05 13:06:31.538217 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: request: GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b HTTP/1.1 Jul 05 13:06:31.538217 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept: application/json Jul 05 13:06:31.538217 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept-Encoding: identity Jul 05 13:06:31.538217 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Connection: close Jul 05 13:06:31.538217 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Length: 0 Jul 05 13:06:31.538217 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Type: application/json Jul 05 13:06:31.538217 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Host: 10.222.0.36 Jul 05 13:06:31.538217 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Openstack-System-Scope: None Jul 05 13:06:31.538217 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: User-Agent: python-urllib3/1.26.9 Jul 05 13:06:31.538217 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Auth-Token: gAAAAABixDYWYD5-KTSWF-PzN5qO1tc1RakdLPjXfBvilDWsQo1psKh_qFRHuHivkKH-iP9Oa3e_8UzczAUBoqaCyIK-0JWYeWftSmLFPiSBm9nSNsIqZmt-IbMLoXnltVymxxX8qTTGlTfGqbh0uv6ByTxeigZY20vapbgvLdiiGRX9KHkTM5M Jul 05 13:06:31.538217 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Id: None Jul 05 13:06:31.538217 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Name: None Jul 05 13:06:31.538217 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Identity-Status: Confirmed Jul 05 13:06:31.538217 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Is-Admin-Project: True Jul 05 13:06:31.538217 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Id: default Jul 05 13:06:31.538217 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Name: Default Jul 05 13:06:31.538217 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Id: 7836a0ee154744b49a323e6b94860e50 Jul 05 13:06:31.538217 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1330957121 Jul 05 13:06:31.538217 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Role: member,reader Jul 05 13:06:31.538217 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Roles: member,reader Jul 05 13:06:31.539704 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7836a0ee154744b49a323e6b94860e50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7836a0ee154744b49a323e6b94860e50", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7836a0ee154744b49a323e6b94860e50"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7836a0ee154744b49a323e6b94860e50"}]}] Jul 05 13:06:31.539704 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1330957121 Jul 05 13:06:31.539704 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Id: 7836a0ee154744b49a323e6b94860e50 Jul 05 13:06:31.539704 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1330957121 Jul 05 13:06:31.539704 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User: tempest-ServerRescueNegativeTestJSON-1330957121-project Jul 05 13:06:31.539704 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Id: default Jul 05 13:06:31.539704 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Name: Default Jul 05 13:06:31.539704 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Id: ad3f91c024f8415cac4784fec0689757 Jul 05 13:06:31.539704 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1330957121-project Jul 05 13:06:31.539704 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: method: > Jul 05 13:06:31.539704 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: exception: Instance 7b7f15b2-a00e-4172-983d-f2a80401953b could not be found. Jul 05 13:06:31.539704 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: action_args: {'id': '7b7f15b2-a00e-4172-983d-f2a80401953b'} Jul 05 13:06:31.540447 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 13:06:31.540447 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:06:31.540447 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 13:06:31.540447 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 13:06:31.540447 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 13:06:31.540447 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 13:06:31.540447 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 13:06:31.540447 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 13:06:31.540447 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 13:06:31.540447 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 13:06:31.540447 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b7f15b2-a00e-4172-983d-f2a80401953b could not be found. Jul 05 13:06:31.540447 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:06:31.540447 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:06:31.540447 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:06:31.540447 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:06:31.540447 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:06:31.540447 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:06:31.540447 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 13:06:31.540447 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 13:06:31.540447 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 13:06:31.541679 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 13:06:31.541679 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 13:06:31.541679 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 13:06:31.541679 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 13:06:31.541679 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 13:06:31.541679 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 13:06:31.541679 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 13:06:31.541679 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b7f15b2-a00e-4172-983d-f2a80401953b could not be found. Jul 05 13:06:31.541679 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:06:31.541679 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:06:31.541679 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:06:31.541679 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:06:31.541679 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:06:31.541679 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:06:31.541679 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 13:06:31.541679 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 13:06:31.541679 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b7f15b2-a00e-4172-983d-f2a80401953b could not be found. Jul 05 13:06:31.541679 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:06:31.542718 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-d4f26d36-4dfd-4822-ab59-ef94df9416e6 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Returning 404 to user: Instance 7b7f15b2-a00e-4172-983d-f2a80401953b could not be found. {{(pid=118387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 13:06:31.542718 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-d4f26d36-4dfd-4822-ab59-ef94df9416e6 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b" status: 404 len: 111 microversion: 2.1 time: 0.031131 Jul 05 13:06:31.542718 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 352/706] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:06:31 2022] GET /compute/v2.1/servers/7b7f15b2-a00e-4172-983d-f2a80401953b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 13:06:31.548721 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-284ca2d0-ac46-43ad-a60f-4dd8d98ec31c tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '.version_select at 0x7f70de8b3940>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:31.682741 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-284ca2d0-ac46-43ad-a60f-4dd8d98ec31c tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-657695244" status: 202 len: 0 microversion: 2.1 time: 0.137843 Jul 05 13:06:31.683476 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 355/707] 10.222.0.36 () {58 vars in 1217 bytes} [Tue Jul 5 13:06:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-657695244 => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 13:06:31.841916 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-f90d4a0b-1221-4077-a3c6-941764a2b32e req-007ca368-d412-47a2-93aa-7f26fd751fda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c6520f9-4cce-44f6-a004-5226841dd52a", "name": "network-vif-plugged", "status": "completed", "tag": "0c693613-12ee-4f41-b9c6-7821cfee92f4"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:06:31.850595 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-f90d4a0b-1221-4077-a3c6-941764a2b32e req-007ca368-d412-47a2-93aa-7f26fd751fda service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:31.851167 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-f90d4a0b-1221-4077-a3c6-941764a2b32e req-007ca368-d412-47a2-93aa-7f26fd751fda service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:31.863543 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-f90d4a0b-1221-4077-a3c6-941764a2b32e req-007ca368-d412-47a2-93aa-7f26fd751fda service nova] Creating event network-vif-plugged:0c693613-12ee-4f41-b9c6-7821cfee92f4 for instance 4c6520f9-4cce-44f6-a004-5226841dd52a on hv-cinder-79760 Jul 05 13:06:31.869759 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-f90d4a0b-1221-4077-a3c6-941764a2b32e req-007ca368-d412-47a2-93aa-7f26fd751fda service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031738 Jul 05 13:06:31.870892 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 353/708] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:06:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:06:32.003480 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-6adf9d0a-4e3b-46a2-8fcc-856286634c45 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:06:32.004083 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-6adf9d0a-4e3b-46a2-8fcc-856286634c45 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:32.011320 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-6adf9d0a-4e3b-46a2-8fcc-856286634c45 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:32.011870 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-6adf9d0a-4e3b-46a2-8fcc-856286634c45 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:32.012805 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-6adf9d0a-4e3b-46a2-8fcc-856286634c45 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:32.018537 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-6adf9d0a-4e3b-46a2-8fcc-856286634c45 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:32.059939 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.objects.instance [None req-6adf9d0a-4e3b-46a2-8fcc-856286634c45 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lazy-loading 'flavor' on Instance uuid 42411ae1-103e-4934-9594-aaf06cc8a356 {{(pid=118386) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 13:06:32.245909 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-20e5443c-8469-4ca0-ae9e-00e0d6d37288 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:32.246625 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-20e5443c-8469-4ca0-ae9e-00e0d6d37288 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 4c6520f9-4cce-44f6-a004-5226841dd52a] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:32.254064 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-20e5443c-8469-4ca0-ae9e-00e0d6d37288 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:32.254518 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-20e5443c-8469-4ca0-ae9e-00e0d6d37288 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:32.255304 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-20e5443c-8469-4ca0-ae9e-00e0d6d37288 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:32.255932 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-20e5443c-8469-4ca0-ae9e-00e0d6d37288 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:32.585564 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-6adf9d0a-4e3b-46a2-8fcc-856286634c45 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "POST /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356/action" status: 202 len: 0 microversion: 2.20 time: 0.585139 Jul 05 13:06:32.586428 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 356/709] 10.222.0.36 () {62 vars in 1318 bytes} [Tue Jul 5 13:06:31 2022] POST /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356/action => generated 0 bytes in 587 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 05 13:06:32.595950 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-fff13a48-caa2-4d93-9328-46a567e16546 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:32.596871 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-fff13a48-caa2-4d93-9328-46a567e16546 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:32.605023 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-fff13a48-caa2-4d93-9328-46a567e16546 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:32.605466 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-fff13a48-caa2-4d93-9328-46a567e16546 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:32.606235 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-fff13a48-caa2-4d93-9328-46a567e16546 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:32.606659 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-fff13a48-caa2-4d93-9328-46a567e16546 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:32.664000 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-20e5443c-8469-4ca0-ae9e-00e0d6d37288 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:32.672076 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-20e5443c-8469-4ca0-ae9e-00e0d6d37288 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/4c6520f9-4cce-44f6-a004-5226841dd52a" status: 200 len: 1367 microversion: 2.1 time: 0.432522 Jul 05 13:06:32.672799 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 354/710] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:06:32 2022] GET /compute/v2.1/servers/4c6520f9-4cce-44f6-a004-5226841dd52a => generated 1367 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:06:32.783995 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-fff13a48-caa2-4d93-9328-46a567e16546 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:32.792563 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-fff13a48-caa2-4d93-9328-46a567e16546 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:32.794116 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-fff13a48-caa2-4d93-9328-46a567e16546 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:32.795259 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-fff13a48-caa2-4d93-9328-46a567e16546 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356" status: 200 len: 1723 microversion: 2.20 time: 0.203716 Jul 05 13:06:32.795813 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 357/711] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:06:32 2022] GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356 => generated 1723 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 13:06:33.688533 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-a90abac2-ca07-443d-86a8-f7c52bbe6177 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:33.689132 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-a90abac2-ca07-443d-86a8-f7c52bbe6177 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 4c6520f9-4cce-44f6-a004-5226841dd52a] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:33.695888 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a90abac2-ca07-443d-86a8-f7c52bbe6177 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:33.696442 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a90abac2-ca07-443d-86a8-f7c52bbe6177 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:33.697238 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a90abac2-ca07-443d-86a8-f7c52bbe6177 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:33.697676 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a90abac2-ca07-443d-86a8-f7c52bbe6177 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:33.813750 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-908406bb-87fb-4df6-8aff-793ca564e28c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:33.814321 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-908406bb-87fb-4df6-8aff-793ca564e28c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:33.820918 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-908406bb-87fb-4df6-8aff-793ca564e28c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:33.821371 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-908406bb-87fb-4df6-8aff-793ca564e28c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:33.822154 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-908406bb-87fb-4df6-8aff-793ca564e28c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:33.822590 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-908406bb-87fb-4df6-8aff-793ca564e28c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:33.835965 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-a90abac2-ca07-443d-86a8-f7c52bbe6177 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:33.842034 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-a90abac2-ca07-443d-86a8-f7c52bbe6177 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/4c6520f9-4cce-44f6-a004-5226841dd52a" status: 200 len: 1557 microversion: 2.1 time: 0.157522 Jul 05 13:06:33.842748 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 355/712] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:06:33 2022] GET /compute/v2.1/servers/4c6520f9-4cce-44f6-a004-5226841dd52a => generated 1557 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:06:33.860276 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-3c8006fe-c264-4a27-9477-e281e611dc92 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:33.860810 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-3c8006fe-c264-4a27-9477-e281e611dc92 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 4c6520f9-4cce-44f6-a004-5226841dd52a] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:33.867976 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3c8006fe-c264-4a27-9477-e281e611dc92 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:33.868427 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3c8006fe-c264-4a27-9477-e281e611dc92 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:33.869246 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3c8006fe-c264-4a27-9477-e281e611dc92 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:33.869688 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3c8006fe-c264-4a27-9477-e281e611dc92 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:33.969267 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-3c8006fe-c264-4a27-9477-e281e611dc92 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/4c6520f9-4cce-44f6-a004-5226841dd52a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.113020 Jul 05 13:06:33.970268 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 356/713] 10.222.0.36 () {58 vars in 1274 bytes} [Tue Jul 5 13:06:33 2022] GET /compute/v2.1/servers/4c6520f9-4cce-44f6-a004-5226841dd52a/os-interface => generated 284 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 13:06:33.998964 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-908406bb-87fb-4df6-8aff-793ca564e28c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:34.007885 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-908406bb-87fb-4df6-8aff-793ca564e28c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:34.009624 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-908406bb-87fb-4df6-8aff-793ca564e28c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:34.011211 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-908406bb-87fb-4df6-8aff-793ca564e28c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356" status: 200 len: 1723 microversion: 2.20 time: 0.201556 Jul 05 13:06:34.012000 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 358/714] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:06:33 2022] GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356 => generated 1723 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 13:06:35.037031 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-d746fa16-8ffa-4ea7-8d0a-8541bbab20dd tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:35.040390 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-d746fa16-8ffa-4ea7-8d0a-8541bbab20dd tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:35.050353 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d746fa16-8ffa-4ea7-8d0a-8541bbab20dd tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:35.050353 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d746fa16-8ffa-4ea7-8d0a-8541bbab20dd tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:35.051067 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d746fa16-8ffa-4ea7-8d0a-8541bbab20dd tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:35.058906 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d746fa16-8ffa-4ea7-8d0a-8541bbab20dd tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:35.131460 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [req-d519c478-87c1-4998-bffa-01adccc3effb req-92efed96-c2b5-4436-960b-8ff5ab6caa5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c6520f9-4cce-44f6-a004-5226841dd52a", "tag": "0c693613-12ee-4f41-b9c6-7821cfee92f4"}]} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:06:35.141825 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-d519c478-87c1-4998-bffa-01adccc3effb req-92efed96-c2b5-4436-960b-8ff5ab6caa5c service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:35.142428 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-d519c478-87c1-4998-bffa-01adccc3effb req-92efed96-c2b5-4436-960b-8ff5ab6caa5c service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:35.160214 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.compute.server_external_events [req-d519c478-87c1-4998-bffa-01adccc3effb req-92efed96-c2b5-4436-960b-8ff5ab6caa5c service nova] Creating event network-changed:0c693613-12ee-4f41-b9c6-7821cfee92f4 for instance 4c6520f9-4cce-44f6-a004-5226841dd52a on hv-cinder-79760 Jul 05 13:06:35.167301 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [req-d519c478-87c1-4998-bffa-01adccc3effb req-92efed96-c2b5-4436-960b-8ff5ab6caa5c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102224 Jul 05 13:06:35.168092 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 359/715] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:06:35.218137 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-d746fa16-8ffa-4ea7-8d0a-8541bbab20dd tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:35.228874 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-d746fa16-8ffa-4ea7-8d0a-8541bbab20dd tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:35.230725 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-d746fa16-8ffa-4ea7-8d0a-8541bbab20dd tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:35.232124 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-d746fa16-8ffa-4ea7-8d0a-8541bbab20dd tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356" status: 200 len: 1723 microversion: 2.20 time: 0.205549 Jul 05 13:06:35.232709 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 357/716] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:06:35 2022] GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356 => generated 1723 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:06:35.270658 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-3a62d464-5f85-486a-92e1-d4ceed55939f tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:06:35.274093 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-3a62d464-5f85-486a-92e1-d4ceed55939f tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] [instance: 58708391-4350-4b7e-8616-f3f3534bd2e6] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:35.278406 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-3a62d464-5f85-486a-92e1-d4ceed55939f tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:35.278922 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-3a62d464-5f85-486a-92e1-d4ceed55939f tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:35.279973 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-3a62d464-5f85-486a-92e1-d4ceed55939f tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:35.280643 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-3a62d464-5f85-486a-92e1-d4ceed55939f tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:35.306500 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.objects.instance [None req-3a62d464-5f85-486a-92e1-d4ceed55939f tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lazy-loading 'flavor' on Instance uuid 58708391-4350-4b7e-8616-f3f3534bd2e6 {{(pid=118386) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 13:06:35.397983 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:06:35.604052 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-3a62d464-5f85-486a-92e1-d4ceed55939f tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] 10.222.0.36 "POST /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6/action" status: 202 len: 0 microversion: 2.1 time: 0.336345 Jul 05 13:06:35.605791 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 360/717] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Jul 5 13:06:35 2022] POST /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6/action => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 13:06:35.621513 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-95e25f6f-7a1c-4cc3-8e83-bda490a0f852 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:35.622456 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-95e25f6f-7a1c-4cc3-8e83-bda490a0f852 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] [instance: 58708391-4350-4b7e-8616-f3f3534bd2e6] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:35.629274 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-95e25f6f-7a1c-4cc3-8e83-bda490a0f852 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:35.630010 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-95e25f6f-7a1c-4cc3-8e83-bda490a0f852 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:35.631167 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-95e25f6f-7a1c-4cc3-8e83-bda490a0f852 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:35.631786 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-95e25f6f-7a1c-4cc3-8e83-bda490a0f852 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:35.793151 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-95e25f6f-7a1c-4cc3-8e83-bda490a0f852 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf000835f1f48cca0a46b233e52c8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec699c3dd1ab470c8cc0685e6e9f766a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:35.802882 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-95e25f6f-7a1c-4cc3-8e83-bda490a0f852 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] 10.222.0.36 "GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6" status: 200 len: 1569 microversion: 2.1 time: 0.192019 Jul 05 13:06:35.803683 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 358/718] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:06:35 2022] GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6 => generated 1569 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:06:35.806957 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-8132c480-df57-4b82-b052-87cc321f7732 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:35.807620 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-8132c480-df57-4b82-b052-87cc321f7732 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:35.819985 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-8132c480-df57-4b82-b052-87cc321f7732 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:35.820785 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-8132c480-df57-4b82-b052-87cc321f7732 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:35.821591 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-8132c480-df57-4b82-b052-87cc321f7732 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:35.822130 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-8132c480-df57-4b82-b052-87cc321f7732 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:35.852135 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-8132c480-df57-4b82-b052-87cc321f7732 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Going to try to terminate instance {{(pid=118386) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 13:06:36.224501 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-8132c480-df57-4b82-b052-87cc321f7732 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 204 len: 0 microversion: 2.1 time: 0.421832 Jul 05 13:06:36.225139 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 361/719] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jul 5 13:06:35 2022] DELETE /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 05 13:06:36.233824 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-59256e02-e8c2-4fa4-9e34-de01801fc604 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:36.234436 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-59256e02-e8c2-4fa4-9e34-de01801fc604 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:36.241064 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-59256e02-e8c2-4fa4-9e34-de01801fc604 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:36.241509 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-59256e02-e8c2-4fa4-9e34-de01801fc604 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:36.242268 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-59256e02-e8c2-4fa4-9e34-de01801fc604 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:36.242728 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-59256e02-e8c2-4fa4-9e34-de01801fc604 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:36.253384 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-0d52fd74-f103-44cf-b60d-603fe057936a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:36.254085 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-0d52fd74-f103-44cf-b60d-603fe057936a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:36.261194 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-0d52fd74-f103-44cf-b60d-603fe057936a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:36.261630 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-0d52fd74-f103-44cf-b60d-603fe057936a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:36.262572 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-0d52fd74-f103-44cf-b60d-603fe057936a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:36.263250 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-0d52fd74-f103-44cf-b60d-603fe057936a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:36.459882 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-59256e02-e8c2-4fa4-9e34-de01801fc604 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:36.463132 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-0d52fd74-f103-44cf-b60d-603fe057936a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:36.467700 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-59256e02-e8c2-4fa4-9e34-de01801fc604 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1508 microversion: 2.1 time: 0.238343 Jul 05 13:06:36.468326 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 359/720] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:06:36 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1508 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:06:36.471370 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-0d52fd74-f103-44cf-b60d-603fe057936a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:36.472886 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-0d52fd74-f103-44cf-b60d-603fe057936a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:36.486154 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-0d52fd74-f103-44cf-b60d-603fe057936a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356" status: 200 len: 1723 microversion: 2.20 time: 0.227032 Jul 05 13:06:36.486154 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 362/721] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:06:36 2022] GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356 => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 13:06:36.822408 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-8e434171-85d1-46f6-a393-2817ad9db629 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:36.823020 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-8e434171-85d1-46f6-a393-2817ad9db629 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] [instance: 58708391-4350-4b7e-8616-f3f3534bd2e6] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:36.829039 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8e434171-85d1-46f6-a393-2817ad9db629 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:36.829472 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8e434171-85d1-46f6-a393-2817ad9db629 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:36.830228 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8e434171-85d1-46f6-a393-2817ad9db629 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:36.830668 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8e434171-85d1-46f6-a393-2817ad9db629 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:36.968893 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-8e434171-85d1-46f6-a393-2817ad9db629 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf000835f1f48cca0a46b233e52c8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec699c3dd1ab470c8cc0685e6e9f766a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:36.976917 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-8e434171-85d1-46f6-a393-2817ad9db629 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] 10.222.0.36 "GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6" status: 200 len: 1569 microversion: 2.1 time: 0.158316 Jul 05 13:06:36.977487 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 360/722] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:06:36 2022] GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:06:37.485402 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-f70c09ce-1982-4f1d-92fc-f3359b51253b tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:37.486008 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-f70c09ce-1982-4f1d-92fc-f3359b51253b tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:37.492486 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f70c09ce-1982-4f1d-92fc-f3359b51253b tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:37.492973 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f70c09ce-1982-4f1d-92fc-f3359b51253b tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:37.494251 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f70c09ce-1982-4f1d-92fc-f3359b51253b tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:37.494888 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f70c09ce-1982-4f1d-92fc-f3359b51253b tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:37.502898 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-4c79bcb5-b732-4f14-b5e8-00508770ce3a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:37.503524 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-4c79bcb5-b732-4f14-b5e8-00508770ce3a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:37.510603 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4c79bcb5-b732-4f14-b5e8-00508770ce3a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:37.511057 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4c79bcb5-b732-4f14-b5e8-00508770ce3a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:37.511824 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4c79bcb5-b732-4f14-b5e8-00508770ce3a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:37.512260 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4c79bcb5-b732-4f14-b5e8-00508770ce3a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:37.696122 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-f70c09ce-1982-4f1d-92fc-f3359b51253b tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:37.703138 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-4c79bcb5-b732-4f14-b5e8-00508770ce3a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:37.703843 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-f70c09ce-1982-4f1d-92fc-f3359b51253b tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1508 microversion: 2.1 time: 0.222258 Jul 05 13:06:37.704412 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 363/723] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:06:37 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1508 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:06:37.711713 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-4c79bcb5-b732-4f14-b5e8-00508770ce3a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:37.713343 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-4c79bcb5-b732-4f14-b5e8-00508770ce3a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:37.714495 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-4c79bcb5-b732-4f14-b5e8-00508770ce3a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356" status: 200 len: 1723 microversion: 2.20 time: 0.215592 Jul 05 13:06:37.715043 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 361/724] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:06:37 2022] GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356 => generated 1723 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 13:06:37.994222 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-ad207db0-5762-4019-8dd2-5df248982712 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:37.994865 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-ad207db0-5762-4019-8dd2-5df248982712 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] [instance: 58708391-4350-4b7e-8616-f3f3534bd2e6] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:38.001150 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ad207db0-5762-4019-8dd2-5df248982712 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:38.001587 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ad207db0-5762-4019-8dd2-5df248982712 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:38.002340 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ad207db0-5762-4019-8dd2-5df248982712 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:38.002768 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ad207db0-5762-4019-8dd2-5df248982712 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:38.133158 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-ad207db0-5762-4019-8dd2-5df248982712 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf000835f1f48cca0a46b233e52c8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec699c3dd1ab470c8cc0685e6e9f766a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:38.140843 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-ad207db0-5762-4019-8dd2-5df248982712 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] 10.222.0.36 "GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6" status: 200 len: 1569 microversion: 2.1 time: 0.151177 Jul 05 13:06:38.141398 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 364/725] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:06:37 2022] GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:06:38.721500 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-3ab633f0-a5e6-4e93-8b59-ba9c5bed659e tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:38.722213 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-3ab633f0-a5e6-4e93-8b59-ba9c5bed659e tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:38.728898 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3ab633f0-a5e6-4e93-8b59-ba9c5bed659e tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:38.729364 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3ab633f0-a5e6-4e93-8b59-ba9c5bed659e tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:38.730398 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3ab633f0-a5e6-4e93-8b59-ba9c5bed659e tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:38.730839 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3ab633f0-a5e6-4e93-8b59-ba9c5bed659e tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:38.732495 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-2d2371fa-85d9-4a8b-a716-b330904b2ff9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:38.733163 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-2d2371fa-85d9-4a8b-a716-b330904b2ff9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:38.739841 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-2d2371fa-85d9-4a8b-a716-b330904b2ff9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:38.740299 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-2d2371fa-85d9-4a8b-a716-b330904b2ff9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:38.741732 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-2d2371fa-85d9-4a8b-a716-b330904b2ff9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:38.742389 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-2d2371fa-85d9-4a8b-a716-b330904b2ff9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:38.941757 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-2d2371fa-85d9-4a8b-a716-b330904b2ff9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:38.944869 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-3ab633f0-a5e6-4e93-8b59-ba9c5bed659e tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:38.952953 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-3ab633f0-a5e6-4e93-8b59-ba9c5bed659e tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1508 microversion: 2.1 time: 0.235269 Jul 05 13:06:38.953528 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 362/726] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:06:38 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1508 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:06:38.954242 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-2d2371fa-85d9-4a8b-a716-b330904b2ff9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:38.955734 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-2d2371fa-85d9-4a8b-a716-b330904b2ff9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:38.957001 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-2d2371fa-85d9-4a8b-a716-b330904b2ff9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356" status: 200 len: 1723 microversion: 2.20 time: 0.228514 Jul 05 13:06:38.957620 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 365/727] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:06:38 2022] GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356 => generated 1723 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:06:39.160992 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-716779cd-ead1-479e-a381-5168b0a142f2 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:39.161610 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-716779cd-ead1-479e-a381-5168b0a142f2 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] [instance: 58708391-4350-4b7e-8616-f3f3534bd2e6] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:39.164841 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:06:39.168351 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-716779cd-ead1-479e-a381-5168b0a142f2 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:39.168828 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-716779cd-ead1-479e-a381-5168b0a142f2 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:39.169869 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-716779cd-ead1-479e-a381-5168b0a142f2 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:39.170308 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-716779cd-ead1-479e-a381-5168b0a142f2 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:39.201614 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [req-25605c1b-3c74-4758-a002-aa3ebf05dbfb req-b56539dc-05ac-4ebf-ad22-9ed2c44769bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f896e7e9-27f6-4b6a-899c-ad0e27c88174", "name": "network-vif-deleted", "tag": "ce02c625-8d30-42c8-adf6-df23075f0cb7"}]} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:06:39.212071 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-25605c1b-3c74-4758-a002-aa3ebf05dbfb req-b56539dc-05ac-4ebf-ad22-9ed2c44769bd service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:39.215538 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-25605c1b-3c74-4758-a002-aa3ebf05dbfb req-b56539dc-05ac-4ebf-ad22-9ed2c44769bd service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:39.228056 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.compute.server_external_events [req-25605c1b-3c74-4758-a002-aa3ebf05dbfb req-b56539dc-05ac-4ebf-ad22-9ed2c44769bd service nova] Creating event network-vif-deleted:ce02c625-8d30-42c8-adf6-df23075f0cb7 for instance f896e7e9-27f6-4b6a-899c-ad0e27c88174 on hv-cinder-79760 Jul 05 13:06:39.234226 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [req-25605c1b-3c74-4758-a002-aa3ebf05dbfb req-b56539dc-05ac-4ebf-ad22-9ed2c44769bd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035499 Jul 05 13:06:39.234833 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 366/728] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:06:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 13:06:39.316515 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-716779cd-ead1-479e-a381-5168b0a142f2 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf000835f1f48cca0a46b233e52c8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec699c3dd1ab470c8cc0685e6e9f766a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:39.324666 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-716779cd-ead1-479e-a381-5168b0a142f2 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] 10.222.0.36 "GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6" status: 200 len: 1569 microversion: 2.1 time: 0.169251 Jul 05 13:06:39.325286 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 363/729] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:06:39 2022] GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6 => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:06:39.971000 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-f805edec-ffcc-4667-babc-e8fef028dc0f tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:39.971688 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-f805edec-ffcc-4667-babc-e8fef028dc0f tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:39.974096 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=2,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:06:39.975144 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-8ad6533a-6e23-4e24-8207-a88323890b75 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:39.976268 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-8ad6533a-6e23-4e24-8207-a88323890b75 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:39.980049 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f805edec-ffcc-4667-babc-e8fef028dc0f tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:39.980495 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f805edec-ffcc-4667-babc-e8fef028dc0f tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:39.981268 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f805edec-ffcc-4667-babc-e8fef028dc0f tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:39.981691 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f805edec-ffcc-4667-babc-e8fef028dc0f tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:39.984148 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8ad6533a-6e23-4e24-8207-a88323890b75 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:39.984632 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8ad6533a-6e23-4e24-8207-a88323890b75 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:39.985406 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8ad6533a-6e23-4e24-8207-a88323890b75 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:39.985843 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8ad6533a-6e23-4e24-8207-a88323890b75 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:40.013555 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f805edec-ffcc-4667-babc-e8fef028dc0f tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:40.013993 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f805edec-ffcc-4667-babc-e8fef028dc0f tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:40.014478 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.objects.instance [None req-f805edec-ffcc-4667-babc-e8fef028dc0f tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lazy-loading 'fault' on Instance uuid f896e7e9-27f6-4b6a-899c-ad0e27c88174 {{(pid=118386) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 13:06:40.087581 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-f805edec-ffcc-4667-babc-e8fef028dc0f tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:40.097752 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-f805edec-ffcc-4667-babc-e8fef028dc0f tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 200 len: 1312 microversion: 2.1 time: 0.130724 Jul 05 13:06:40.098291 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 367/730] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:06:39 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 1312 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:06:40.155524 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-8ad6533a-6e23-4e24-8207-a88323890b75 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:40.164234 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-8ad6533a-6e23-4e24-8207-a88323890b75 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:40.165692 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-8ad6533a-6e23-4e24-8207-a88323890b75 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:40.166860 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-8ad6533a-6e23-4e24-8207-a88323890b75 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356" status: 200 len: 1723 microversion: 2.20 time: 0.195596 Jul 05 13:06:40.167423 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 364/731] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:06:39 2022] GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356 => generated 1723 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 13:06:40.342668 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-d928d1cb-b65b-4006-988a-e1f500ee9a97 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:40.343300 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-d928d1cb-b65b-4006-988a-e1f500ee9a97 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] [instance: 58708391-4350-4b7e-8616-f3f3534bd2e6] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:40.350300 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-d928d1cb-b65b-4006-988a-e1f500ee9a97 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:40.351355 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-d928d1cb-b65b-4006-988a-e1f500ee9a97 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:40.352115 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-d928d1cb-b65b-4006-988a-e1f500ee9a97 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:40.352552 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-d928d1cb-b65b-4006-988a-e1f500ee9a97 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:40.484977 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-d928d1cb-b65b-4006-988a-e1f500ee9a97 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf000835f1f48cca0a46b233e52c8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec699c3dd1ab470c8cc0685e6e9f766a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:40.492358 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-d928d1cb-b65b-4006-988a-e1f500ee9a97 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] 10.222.0.36 "GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6" status: 200 len: 1569 microversion: 2.1 time: 0.153980 Jul 05 13:06:40.492946 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 368/732] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:06:40 2022] GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:06:41.115407 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-7ee84c67-22b7-4646-9ac3-22c04dcb8d06 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:41.116524 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-7ee84c67-22b7-4646-9ac3-22c04dcb8d06 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: f896e7e9-27f6-4b6a-899c-ad0e27c88174] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:41.123307 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7ee84c67-22b7-4646-9ac3-22c04dcb8d06 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:41.123754 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7ee84c67-22b7-4646-9ac3-22c04dcb8d06 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:41.124523 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7ee84c67-22b7-4646-9ac3-22c04dcb8d06 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:41.124978 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7ee84c67-22b7-4646-9ac3-22c04dcb8d06 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:41.139439 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.wsgi [None req-7ee84c67-22b7-4646-9ac3-22c04dcb8d06 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] HTTP exception thrown: Instance f896e7e9-27f6-4b6a-899c-ad0e27c88174 could not be found. Jul 05 13:06:41.141104 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-7ee84c67-22b7-4646-9ac3-22c04dcb8d06 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Request method failure captured: Jul 05 13:06:41.141104 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: request: GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 HTTP/1.1 Jul 05 13:06:41.141104 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept: application/json Jul 05 13:06:41.141104 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept-Encoding: identity Jul 05 13:06:41.141104 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Connection: close Jul 05 13:06:41.141104 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Length: 0 Jul 05 13:06:41.141104 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Type: application/json Jul 05 13:06:41.141104 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Host: 10.222.0.36 Jul 05 13:06:41.141104 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Openstack-System-Scope: None Jul 05 13:06:41.141104 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: User-Agent: python-urllib3/1.26.9 Jul 05 13:06:41.141104 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Auth-Token: gAAAAABixDYWYD5-KTSWF-PzN5qO1tc1RakdLPjXfBvilDWsQo1psKh_qFRHuHivkKH-iP9Oa3e_8UzczAUBoqaCyIK-0JWYeWftSmLFPiSBm9nSNsIqZmt-IbMLoXnltVymxxX8qTTGlTfGqbh0uv6ByTxeigZY20vapbgvLdiiGRX9KHkTM5M Jul 05 13:06:41.141104 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Id: None Jul 05 13:06:41.141104 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Name: None Jul 05 13:06:41.141104 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Identity-Status: Confirmed Jul 05 13:06:41.141104 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Is-Admin-Project: True Jul 05 13:06:41.141104 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Id: default Jul 05 13:06:41.141104 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Name: Default Jul 05 13:06:41.141104 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Id: 7836a0ee154744b49a323e6b94860e50 Jul 05 13:06:41.141104 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1330957121 Jul 05 13:06:41.141104 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Role: member,reader Jul 05 13:06:41.141104 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Roles: member,reader Jul 05 13:06:41.142683 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7836a0ee154744b49a323e6b94860e50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7836a0ee154744b49a323e6b94860e50", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7836a0ee154744b49a323e6b94860e50"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7836a0ee154744b49a323e6b94860e50"}]}] Jul 05 13:06:41.142683 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1330957121 Jul 05 13:06:41.142683 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Id: 7836a0ee154744b49a323e6b94860e50 Jul 05 13:06:41.142683 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1330957121 Jul 05 13:06:41.142683 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User: tempest-ServerRescueNegativeTestJSON-1330957121-project Jul 05 13:06:41.142683 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Id: default Jul 05 13:06:41.142683 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Name: Default Jul 05 13:06:41.142683 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Id: ad3f91c024f8415cac4784fec0689757 Jul 05 13:06:41.142683 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1330957121-project Jul 05 13:06:41.142683 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: method: > Jul 05 13:06:41.142683 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: exception: Instance f896e7e9-27f6-4b6a-899c-ad0e27c88174 could not be found. Jul 05 13:06:41.142683 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: action_args: {'id': 'f896e7e9-27f6-4b6a-899c-ad0e27c88174'} Jul 05 13:06:41.143635 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 13:06:41.143635 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:06:41.143635 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 13:06:41.143635 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 13:06:41.143635 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 13:06:41.143635 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 13:06:41.143635 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 13:06:41.143635 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 13:06:41.143635 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 13:06:41.143635 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 13:06:41.143635 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f896e7e9-27f6-4b6a-899c-ad0e27c88174 could not be found. Jul 05 13:06:41.143635 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:06:41.143635 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:06:41.143635 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:06:41.143635 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:06:41.143635 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:06:41.143635 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:06:41.143635 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 13:06:41.143635 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 13:06:41.143635 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 13:06:41.145173 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 13:06:41.145173 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 13:06:41.145173 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 13:06:41.145173 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 13:06:41.145173 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 13:06:41.145173 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 13:06:41.145173 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 13:06:41.145173 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f896e7e9-27f6-4b6a-899c-ad0e27c88174 could not be found. Jul 05 13:06:41.145173 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:06:41.145173 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:06:41.145173 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:06:41.145173 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:06:41.145173 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:06:41.145173 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:06:41.145173 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 13:06:41.145173 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 13:06:41.145173 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f896e7e9-27f6-4b6a-899c-ad0e27c88174 could not be found. Jul 05 13:06:41.145173 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:06:41.147866 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-7ee84c67-22b7-4646-9ac3-22c04dcb8d06 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Returning 404 to user: Instance f896e7e9-27f6-4b6a-899c-ad0e27c88174 could not be found. {{(pid=118387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 13:06:41.147866 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-7ee84c67-22b7-4646-9ac3-22c04dcb8d06 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174" status: 404 len: 111 microversion: 2.1 time: 0.030952 Jul 05 13:06:41.147866 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 365/733] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:06:41 2022] GET /compute/v2.1/servers/f896e7e9-27f6-4b6a-899c-ad0e27c88174 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 13:06:41.152152 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-6471d95f-0511-4bb5-a8da-4fa0f097a293 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:41.152714 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-6471d95f-0511-4bb5-a8da-4fa0f097a293 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 2d17971e-35b1-437a-baca-1306740b41c0] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:41.159287 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-6471d95f-0511-4bb5-a8da-4fa0f097a293 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:41.159734 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-6471d95f-0511-4bb5-a8da-4fa0f097a293 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:41.160495 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-6471d95f-0511-4bb5-a8da-4fa0f097a293 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:41.161041 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-6471d95f-0511-4bb5-a8da-4fa0f097a293 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:41.185716 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-26fd1732-adef-4e86-b97f-f94a87cf5488 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:41.186246 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-26fd1732-adef-4e86-b97f-f94a87cf5488 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:41.187500 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-6471d95f-0511-4bb5-a8da-4fa0f097a293 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 2d17971e-35b1-437a-baca-1306740b41c0] Going to try to terminate instance {{(pid=118386) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 13:06:41.192317 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-26fd1732-adef-4e86-b97f-f94a87cf5488 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:41.192812 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-26fd1732-adef-4e86-b97f-f94a87cf5488 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:41.193575 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-26fd1732-adef-4e86-b97f-f94a87cf5488 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:41.194010 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-26fd1732-adef-4e86-b97f-f94a87cf5488 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:41.326465 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-26fd1732-adef-4e86-b97f-f94a87cf5488 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:41.330058 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell1:SELECT=100 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:06:41.334806 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-26fd1732-adef-4e86-b97f-f94a87cf5488 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:41.336381 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-26fd1732-adef-4e86-b97f-f94a87cf5488 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:41.343051 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-26fd1732-adef-4e86-b97f-f94a87cf5488 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356" status: 200 len: 1723 microversion: 2.20 time: 0.155929 Jul 05 13:06:41.343051 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 366/734] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:06:41 2022] GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 13:06:41.510263 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-1f346bbe-d36b-4a2b-b4b3-244d38e18a91 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:41.510788 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-1f346bbe-d36b-4a2b-b4b3-244d38e18a91 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] [instance: 58708391-4350-4b7e-8616-f3f3534bd2e6] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:41.515527 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-6471d95f-0511-4bb5-a8da-4fa0f097a293 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "DELETE /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0" status: 204 len: 0 microversion: 2.1 time: 0.367015 Jul 05 13:06:41.516134 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 369/735] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jul 5 13:06:41 2022] DELETE /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 05 13:06:41.516934 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1f346bbe-d36b-4a2b-b4b3-244d38e18a91 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:41.517495 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1f346bbe-d36b-4a2b-b4b3-244d38e18a91 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:41.518274 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1f346bbe-d36b-4a2b-b4b3-244d38e18a91 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:41.518712 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1f346bbe-d36b-4a2b-b4b3-244d38e18a91 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:41.525881 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-e5e0333d-6e33-4c27-b5f3-f83caa34fe2e tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:41.531099 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-e5e0333d-6e33-4c27-b5f3-f83caa34fe2e tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 2d17971e-35b1-437a-baca-1306740b41c0] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:41.534163 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e5e0333d-6e33-4c27-b5f3-f83caa34fe2e tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:41.534594 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e5e0333d-6e33-4c27-b5f3-f83caa34fe2e tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:41.535363 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e5e0333d-6e33-4c27-b5f3-f83caa34fe2e tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:41.535775 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e5e0333d-6e33-4c27-b5f3-f83caa34fe2e tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:41.706540 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-1f346bbe-d36b-4a2b-b4b3-244d38e18a91 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf000835f1f48cca0a46b233e52c8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec699c3dd1ab470c8cc0685e6e9f766a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:41.714212 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-1f346bbe-d36b-4a2b-b4b3-244d38e18a91 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] 10.222.0.36 "GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6" status: 200 len: 1569 microversion: 2.1 time: 0.208746 Jul 05 13:06:41.714784 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 367/736] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:06:41 2022] GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6 => generated 1569 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:06:41.729049 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-e5e0333d-6e33-4c27-b5f3-f83caa34fe2e tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:41.736777 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-e5e0333d-6e33-4c27-b5f3-f83caa34fe2e tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0" status: 200 len: 1522 microversion: 2.1 time: 0.216018 Jul 05 13:06:41.737329 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 370/737] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:06:41 2022] GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0 => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:06:42.355758 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-38048fd9-e118-4030-95ca-df42b79537cf tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:42.356295 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-38048fd9-e118-4030-95ca-df42b79537cf tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:42.362808 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-38048fd9-e118-4030-95ca-df42b79537cf tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:42.363246 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-38048fd9-e118-4030-95ca-df42b79537cf tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:42.363996 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-38048fd9-e118-4030-95ca-df42b79537cf tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:42.364426 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-38048fd9-e118-4030-95ca-df42b79537cf tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:42.491608 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-38048fd9-e118-4030-95ca-df42b79537cf tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:42.499414 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-38048fd9-e118-4030-95ca-df42b79537cf tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:42.500977 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-38048fd9-e118-4030-95ca-df42b79537cf tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:42.502132 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-38048fd9-e118-4030-95ca-df42b79537cf tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356" status: 200 len: 1723 microversion: 2.20 time: 0.150649 Jul 05 13:06:42.502692 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 368/738] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:06:42 2022] GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:06:42.731253 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-1a2fb7c4-bd69-47b5-8ccf-0e615dd77958 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:42.731796 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-1a2fb7c4-bd69-47b5-8ccf-0e615dd77958 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] [instance: 58708391-4350-4b7e-8616-f3f3534bd2e6] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:42.738382 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-1a2fb7c4-bd69-47b5-8ccf-0e615dd77958 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:42.738932 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-1a2fb7c4-bd69-47b5-8ccf-0e615dd77958 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:42.739696 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-1a2fb7c4-bd69-47b5-8ccf-0e615dd77958 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:42.740161 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-1a2fb7c4-bd69-47b5-8ccf-0e615dd77958 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:42.754193 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-7e17a91d-a1e7-4ac5-93c0-35b4ce665886 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:42.754923 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-7e17a91d-a1e7-4ac5-93c0-35b4ce665886 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 2d17971e-35b1-437a-baca-1306740b41c0] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:42.761437 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7e17a91d-a1e7-4ac5-93c0-35b4ce665886 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:42.761886 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7e17a91d-a1e7-4ac5-93c0-35b4ce665886 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:42.762646 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7e17a91d-a1e7-4ac5-93c0-35b4ce665886 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:42.763082 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7e17a91d-a1e7-4ac5-93c0-35b4ce665886 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:42.939049 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-1a2fb7c4-bd69-47b5-8ccf-0e615dd77958 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf000835f1f48cca0a46b233e52c8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec699c3dd1ab470c8cc0685e6e9f766a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:42.943575 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-7e17a91d-a1e7-4ac5-93c0-35b4ce665886 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:42.947526 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-1a2fb7c4-bd69-47b5-8ccf-0e615dd77958 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] 10.222.0.36 "GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6" status: 200 len: 1569 microversion: 2.1 time: 0.220399 Jul 05 13:06:42.948091 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 371/739] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:06:42 2022] GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6 => generated 1569 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:06:42.951667 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-7e17a91d-a1e7-4ac5-93c0-35b4ce665886 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0" status: 200 len: 1522 microversion: 2.1 time: 0.201220 Jul 05 13:06:42.952100 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 369/740] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:06:42 2022] GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0 => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:06:43.520182 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-f3f1b183-fa9d-4dbd-8f1d-79499d161737 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:43.520747 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-f3f1b183-fa9d-4dbd-8f1d-79499d161737 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:43.526745 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f3f1b183-fa9d-4dbd-8f1d-79499d161737 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:43.527185 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f3f1b183-fa9d-4dbd-8f1d-79499d161737 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:43.527926 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f3f1b183-fa9d-4dbd-8f1d-79499d161737 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:43.528350 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f3f1b183-fa9d-4dbd-8f1d-79499d161737 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:43.655657 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-f3f1b183-fa9d-4dbd-8f1d-79499d161737 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:43.663944 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-f3f1b183-fa9d-4dbd-8f1d-79499d161737 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:43.665446 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-f3f1b183-fa9d-4dbd-8f1d-79499d161737 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:43.666613 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-f3f1b183-fa9d-4dbd-8f1d-79499d161737 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356" status: 200 len: 1723 microversion: 2.20 time: 0.150333 Jul 05 13:06:43.667209 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 372/741] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:06:43 2022] GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:06:43.964208 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-ebbd69de-7113-464c-a516-e5c5639c04c3 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:43.964854 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-ebbd69de-7113-464c-a516-e5c5639c04c3 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] [instance: 58708391-4350-4b7e-8616-f3f3534bd2e6] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:43.968110 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-af8091f7-9e41-4026-9004-4d2e96f717d2 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:43.968747 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-af8091f7-9e41-4026-9004-4d2e96f717d2 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 2d17971e-35b1-437a-baca-1306740b41c0] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:43.972009 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ebbd69de-7113-464c-a516-e5c5639c04c3 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:43.972160 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ebbd69de-7113-464c-a516-e5c5639c04c3 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:43.972980 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ebbd69de-7113-464c-a516-e5c5639c04c3 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:43.973412 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ebbd69de-7113-464c-a516-e5c5639c04c3 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:43.975117 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-af8091f7-9e41-4026-9004-4d2e96f717d2 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:43.975597 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-af8091f7-9e41-4026-9004-4d2e96f717d2 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:43.976965 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-af8091f7-9e41-4026-9004-4d2e96f717d2 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:43.977392 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-af8091f7-9e41-4026-9004-4d2e96f717d2 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:43.981651 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:06:44.170391 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-ebbd69de-7113-464c-a516-e5c5639c04c3 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf000835f1f48cca0a46b233e52c8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec699c3dd1ab470c8cc0685e6e9f766a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:44.177776 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-af8091f7-9e41-4026-9004-4d2e96f717d2 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:44.178002 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-ebbd69de-7113-464c-a516-e5c5639c04c3 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] 10.222.0.36 "GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6" status: 200 len: 1569 microversion: 2.1 time: 0.218135 Jul 05 13:06:44.178579 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 370/742] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:06:43 2022] GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6 => generated 1569 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:06:44.185524 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-af8091f7-9e41-4026-9004-4d2e96f717d2 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0" status: 200 len: 1522 microversion: 2.1 time: 0.221166 Jul 05 13:06:44.187358 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 373/743] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:06:43 2022] GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0 => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:06:44.685454 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-eb908825-1dd1-4be4-9d6d-4a4ad2c365c1 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:44.686289 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-eb908825-1dd1-4be4-9d6d-4a4ad2c365c1 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:44.692361 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-eb908825-1dd1-4be4-9d6d-4a4ad2c365c1 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:44.692917 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-eb908825-1dd1-4be4-9d6d-4a4ad2c365c1 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:44.693835 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-eb908825-1dd1-4be4-9d6d-4a4ad2c365c1 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:44.694245 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-eb908825-1dd1-4be4-9d6d-4a4ad2c365c1 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:44.825448 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-eb908825-1dd1-4be4-9d6d-4a4ad2c365c1 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:44.833535 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-eb908825-1dd1-4be4-9d6d-4a4ad2c365c1 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:44.835046 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-eb908825-1dd1-4be4-9d6d-4a4ad2c365c1 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:44.836197 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-eb908825-1dd1-4be4-9d6d-4a4ad2c365c1 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356" status: 200 len: 1744 microversion: 2.20 time: 0.154816 Jul 05 13:06:44.836773 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 371/744] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:06:44 2022] GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356 => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:06:44.939648 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [req-7216b39a-9662-4e6c-8e4e-2ec87fcb8eb3 req-19128239-5a16-43c7-bd6d-3a8f81e6da2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d17971e-35b1-437a-baca-1306740b41c0", "name": "network-vif-deleted", "tag": "eec25597-9a2b-4423-aabf-e5608c88a606"}]} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:06:44.948324 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-7216b39a-9662-4e6c-8e4e-2ec87fcb8eb3 req-19128239-5a16-43c7-bd6d-3a8f81e6da2f service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:44.948712 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-7216b39a-9662-4e6c-8e4e-2ec87fcb8eb3 req-19128239-5a16-43c7-bd6d-3a8f81e6da2f service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:44.959147 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.compute.server_external_events [req-7216b39a-9662-4e6c-8e4e-2ec87fcb8eb3 req-19128239-5a16-43c7-bd6d-3a8f81e6da2f service nova] Creating event network-vif-deleted:eec25597-9a2b-4423-aabf-e5608c88a606 for instance 2d17971e-35b1-437a-baca-1306740b41c0 on hv-cinder-79760 Jul 05 13:06:44.965438 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [req-7216b39a-9662-4e6c-8e4e-2ec87fcb8eb3 req-19128239-5a16-43c7-bd6d-3a8f81e6da2f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029668 Jul 05 13:06:44.966020 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 374/745] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:06:45.196189 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-1fcde076-9755-4bf1-9b25-624dbe95722c tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:45.196764 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-1fcde076-9755-4bf1-9b25-624dbe95722c tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] [instance: 58708391-4350-4b7e-8616-f3f3534bd2e6] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:45.203827 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1fcde076-9755-4bf1-9b25-624dbe95722c tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:45.204362 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1fcde076-9755-4bf1-9b25-624dbe95722c tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:45.205168 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1fcde076-9755-4bf1-9b25-624dbe95722c tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:45.205609 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1fcde076-9755-4bf1-9b25-624dbe95722c tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:45.206894 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-4c846ac6-82e8-4b26-bcb3-d50b2f6b9464 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:45.207704 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-4c846ac6-82e8-4b26-bcb3-d50b2f6b9464 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 2d17971e-35b1-437a-baca-1306740b41c0] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:45.217005 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-4c846ac6-82e8-4b26-bcb3-d50b2f6b9464 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:45.217456 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-4c846ac6-82e8-4b26-bcb3-d50b2f6b9464 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:45.218234 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-4c846ac6-82e8-4b26-bcb3-d50b2f6b9464 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:45.218666 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-4c846ac6-82e8-4b26-bcb3-d50b2f6b9464 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:45.261590 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-4c846ac6-82e8-4b26-bcb3-d50b2f6b9464 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:45.262045 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-4c846ac6-82e8-4b26-bcb3-d50b2f6b9464 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:45.262539 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.objects.instance [None req-4c846ac6-82e8-4b26-bcb3-d50b2f6b9464 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lazy-loading 'fault' on Instance uuid 2d17971e-35b1-437a-baca-1306740b41c0 {{(pid=118386) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 13:06:45.315660 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-4c846ac6-82e8-4b26-bcb3-d50b2f6b9464 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3f91c024f8415cac4784fec0689757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836a0ee154744b49a323e6b94860e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:45.324458 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-4c846ac6-82e8-4b26-bcb3-d50b2f6b9464 tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0" status: 200 len: 1311 microversion: 2.1 time: 0.122601 Jul 05 13:06:45.325710 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 375/746] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:06:45 2022] GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0 => generated 1311 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:06:45.383124 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-1fcde076-9755-4bf1-9b25-624dbe95722c tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf000835f1f48cca0a46b233e52c8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec699c3dd1ab470c8cc0685e6e9f766a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:45.392021 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-1fcde076-9755-4bf1-9b25-624dbe95722c tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] 10.222.0.36 "GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6" status: 200 len: 1569 microversion: 2.1 time: 0.200343 Jul 05 13:06:45.392622 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 372/747] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:06:45 2022] GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6 => generated 1569 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:06:45.854845 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-cd935a24-6fbd-4a1b-9d37-c2c4e1645b93 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:45.855456 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-cd935a24-6fbd-4a1b-9d37-c2c4e1645b93 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:45.861410 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-cd935a24-6fbd-4a1b-9d37-c2c4e1645b93 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:45.861844 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-cd935a24-6fbd-4a1b-9d37-c2c4e1645b93 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:45.862600 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-cd935a24-6fbd-4a1b-9d37-c2c4e1645b93 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:45.863031 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-cd935a24-6fbd-4a1b-9d37-c2c4e1645b93 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:45.996833 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-cd935a24-6fbd-4a1b-9d37-c2c4e1645b93 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:46.005446 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-cd935a24-6fbd-4a1b-9d37-c2c4e1645b93 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:46.006924 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-cd935a24-6fbd-4a1b-9d37-c2c4e1645b93 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:46.008072 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-cd935a24-6fbd-4a1b-9d37-c2c4e1645b93 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356" status: 200 len: 1744 microversion: 2.20 time: 0.157932 Jul 05 13:06:46.008653 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 376/748] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:06:45 2022] GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356 => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:06:46.342250 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-d5ed3146-207c-4b24-a5b6-a3dedc3ec28e tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:46.343003 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-d5ed3146-207c-4b24-a5b6-a3dedc3ec28e tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] [instance: 2d17971e-35b1-437a-baca-1306740b41c0] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:46.349608 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d5ed3146-207c-4b24-a5b6-a3dedc3ec28e tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:46.350064 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d5ed3146-207c-4b24-a5b6-a3dedc3ec28e tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:46.350835 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d5ed3146-207c-4b24-a5b6-a3dedc3ec28e tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:46.351271 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d5ed3146-207c-4b24-a5b6-a3dedc3ec28e tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:46.364825 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.wsgi [None req-d5ed3146-207c-4b24-a5b6-a3dedc3ec28e tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] HTTP exception thrown: Instance 2d17971e-35b1-437a-baca-1306740b41c0 could not be found. Jul 05 13:06:46.366860 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-d5ed3146-207c-4b24-a5b6-a3dedc3ec28e tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Request method failure captured: Jul 05 13:06:46.366860 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: request: GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0 HTTP/1.1 Jul 05 13:06:46.366860 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept: application/json Jul 05 13:06:46.366860 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept-Encoding: identity Jul 05 13:06:46.366860 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Connection: close Jul 05 13:06:46.366860 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Length: 0 Jul 05 13:06:46.366860 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Type: application/json Jul 05 13:06:46.366860 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Host: 10.222.0.36 Jul 05 13:06:46.366860 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Openstack-System-Scope: None Jul 05 13:06:46.366860 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: User-Agent: python-urllib3/1.26.9 Jul 05 13:06:46.366860 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Auth-Token: gAAAAABixDYWYD5-KTSWF-PzN5qO1tc1RakdLPjXfBvilDWsQo1psKh_qFRHuHivkKH-iP9Oa3e_8UzczAUBoqaCyIK-0JWYeWftSmLFPiSBm9nSNsIqZmt-IbMLoXnltVymxxX8qTTGlTfGqbh0uv6ByTxeigZY20vapbgvLdiiGRX9KHkTM5M Jul 05 13:06:46.366860 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Id: None Jul 05 13:06:46.366860 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Name: None Jul 05 13:06:46.366860 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Identity-Status: Confirmed Jul 05 13:06:46.366860 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Is-Admin-Project: True Jul 05 13:06:46.366860 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Id: default Jul 05 13:06:46.366860 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Name: Default Jul 05 13:06:46.366860 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Id: 7836a0ee154744b49a323e6b94860e50 Jul 05 13:06:46.366860 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1330957121 Jul 05 13:06:46.366860 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Role: member,reader Jul 05 13:06:46.366860 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Roles: member,reader Jul 05 13:06:46.368522 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7836a0ee154744b49a323e6b94860e50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7836a0ee154744b49a323e6b94860e50", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7836a0ee154744b49a323e6b94860e50"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7836a0ee154744b49a323e6b94860e50"}]}] Jul 05 13:06:46.368522 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1330957121 Jul 05 13:06:46.368522 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Id: 7836a0ee154744b49a323e6b94860e50 Jul 05 13:06:46.368522 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1330957121 Jul 05 13:06:46.368522 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User: tempest-ServerRescueNegativeTestJSON-1330957121-project Jul 05 13:06:46.368522 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Id: default Jul 05 13:06:46.368522 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Name: Default Jul 05 13:06:46.368522 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Id: ad3f91c024f8415cac4784fec0689757 Jul 05 13:06:46.368522 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1330957121-project Jul 05 13:06:46.368522 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: method: > Jul 05 13:06:46.368522 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: exception: Instance 2d17971e-35b1-437a-baca-1306740b41c0 could not be found. Jul 05 13:06:46.368522 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: action_args: {'id': '2d17971e-35b1-437a-baca-1306740b41c0'} Jul 05 13:06:46.369465 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 13:06:46.369465 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:06:46.369465 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 13:06:46.369465 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 13:06:46.369465 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 13:06:46.369465 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 13:06:46.369465 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 13:06:46.369465 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 13:06:46.369465 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 13:06:46.369465 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 13:06:46.369465 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d17971e-35b1-437a-baca-1306740b41c0 could not be found. Jul 05 13:06:46.369465 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:06:46.369465 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:06:46.369465 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:06:46.369465 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:06:46.369465 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:06:46.369465 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:06:46.369465 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 13:06:46.369465 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 13:06:46.369465 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 13:06:46.371094 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 13:06:46.371094 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 13:06:46.371094 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 13:06:46.371094 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 13:06:46.371094 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 13:06:46.371094 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 13:06:46.371094 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 13:06:46.371094 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d17971e-35b1-437a-baca-1306740b41c0 could not be found. Jul 05 13:06:46.371094 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:06:46.371094 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:06:46.371094 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:06:46.371094 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:06:46.371094 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:06:46.371094 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:06:46.371094 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 13:06:46.371094 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 13:06:46.371094 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d17971e-35b1-437a-baca-1306740b41c0 could not be found. Jul 05 13:06:46.371094 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:06:46.372495 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-d5ed3146-207c-4b24-a5b6-a3dedc3ec28e tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] Returning 404 to user: Instance 2d17971e-35b1-437a-baca-1306740b41c0 could not be found. {{(pid=118387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 13:06:46.372495 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-d5ed3146-207c-4b24-a5b6-a3dedc3ec28e tempest-ServerRescueNegativeTestJSON-1330957121 tempest-ServerRescueNegativeTestJSON-1330957121-project] 10.222.0.36 "GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0" status: 404 len: 111 microversion: 2.1 time: 0.030011 Jul 05 13:06:46.372495 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 373/749] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:06:46 2022] GET /compute/v2.1/servers/2d17971e-35b1-437a-baca-1306740b41c0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 13:06:46.410764 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-9df5daa7-d766-4075-b572-6541c7a0af43 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:46.411800 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-9df5daa7-d766-4075-b572-6541c7a0af43 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] [instance: 58708391-4350-4b7e-8616-f3f3534bd2e6] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:46.421754 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-9df5daa7-d766-4075-b572-6541c7a0af43 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:46.422314 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-9df5daa7-d766-4075-b572-6541c7a0af43 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:46.423089 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-9df5daa7-d766-4075-b572-6541c7a0af43 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:46.423547 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-9df5daa7-d766-4075-b572-6541c7a0af43 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:46.646208 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-9df5daa7-d766-4075-b572-6541c7a0af43 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf000835f1f48cca0a46b233e52c8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec699c3dd1ab470c8cc0685e6e9f766a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:46.654855 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-9df5daa7-d766-4075-b572-6541c7a0af43 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] 10.222.0.36 "GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6" status: 200 len: 1569 microversion: 2.1 time: 0.249499 Jul 05 13:06:46.655437 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 377/750] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:06:46 2022] GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6 => generated 1569 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:06:47.026892 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-8aed38ee-0428-4a8b-bf31-157d11af0dec tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:47.027500 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-8aed38ee-0428-4a8b-bf31-157d11af0dec tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:47.033479 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8aed38ee-0428-4a8b-bf31-157d11af0dec tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:47.033947 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8aed38ee-0428-4a8b-bf31-157d11af0dec tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:47.034689 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8aed38ee-0428-4a8b-bf31-157d11af0dec tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:47.035125 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8aed38ee-0428-4a8b-bf31-157d11af0dec tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:47.245853 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-8aed38ee-0428-4a8b-bf31-157d11af0dec tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:47.253761 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-8aed38ee-0428-4a8b-bf31-157d11af0dec tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:47.255262 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-8aed38ee-0428-4a8b-bf31-157d11af0dec tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:47.256421 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-8aed38ee-0428-4a8b-bf31-157d11af0dec tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356" status: 200 len: 1739 microversion: 2.20 time: 0.233557 Jul 05 13:06:47.257001 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 374/751] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:06:47 2022] GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356 => generated 1739 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 13:06:47.673255 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-9ce62bf4-f655-4435-8dd9-e50a106c25a8 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:47.675664 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-9ce62bf4-f655-4435-8dd9-e50a106c25a8 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] [instance: 58708391-4350-4b7e-8616-f3f3534bd2e6] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:47.684023 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-9ce62bf4-f655-4435-8dd9-e50a106c25a8 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:47.684945 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-9ce62bf4-f655-4435-8dd9-e50a106c25a8 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:47.685973 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-9ce62bf4-f655-4435-8dd9-e50a106c25a8 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:47.686626 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-9ce62bf4-f655-4435-8dd9-e50a106c25a8 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:47.910902 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-9ce62bf4-f655-4435-8dd9-e50a106c25a8 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf000835f1f48cca0a46b233e52c8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec699c3dd1ab470c8cc0685e6e9f766a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:47.918975 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-9ce62bf4-f655-4435-8dd9-e50a106c25a8 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] 10.222.0.36 "GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6" status: 200 len: 1569 microversion: 2.1 time: 0.251239 Jul 05 13:06:47.921962 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 378/752] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:06:47 2022] GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6 => generated 1569 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:06:48.274944 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-1c67b52f-6684-42b3-ba00-2463634d5896 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:48.275575 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-1c67b52f-6684-42b3-ba00-2463634d5896 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:48.282198 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1c67b52f-6684-42b3-ba00-2463634d5896 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:48.282651 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1c67b52f-6684-42b3-ba00-2463634d5896 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:48.283417 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1c67b52f-6684-42b3-ba00-2463634d5896 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:48.283852 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1c67b52f-6684-42b3-ba00-2463634d5896 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:48.461305 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-1c67b52f-6684-42b3-ba00-2463634d5896 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:48.471246 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-1c67b52f-6684-42b3-ba00-2463634d5896 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:48.473772 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-1c67b52f-6684-42b3-ba00-2463634d5896 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:48.475849 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-1c67b52f-6684-42b3-ba00-2463634d5896 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356" status: 200 len: 1739 microversion: 2.20 time: 0.205334 Jul 05 13:06:48.477372 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 375/753] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:06:48 2022] GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356 => generated 1739 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:06:48.937926 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-f239aa5a-15c1-415a-ad1d-a83bc835336f tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:48.938651 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-f239aa5a-15c1-415a-ad1d-a83bc835336f tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] [instance: 58708391-4350-4b7e-8616-f3f3534bd2e6] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:48.946781 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f239aa5a-15c1-415a-ad1d-a83bc835336f tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:48.947577 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f239aa5a-15c1-415a-ad1d-a83bc835336f tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:48.948677 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f239aa5a-15c1-415a-ad1d-a83bc835336f tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:48.949725 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f239aa5a-15c1-415a-ad1d-a83bc835336f tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:49.157720 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-f239aa5a-15c1-415a-ad1d-a83bc835336f tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf000835f1f48cca0a46b233e52c8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec699c3dd1ab470c8cc0685e6e9f766a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:49.172019 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-f239aa5a-15c1-415a-ad1d-a83bc835336f tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] 10.222.0.36 "GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6" status: 200 len: 1569 microversion: 2.1 time: 0.239270 Jul 05 13:06:49.174527 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 379/754] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:06:48 2022] GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6 => generated 1569 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:06:49.494828 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-f6fc05fc-1357-426e-b84a-582776a590be tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:49.495473 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-f6fc05fc-1357-426e-b84a-582776a590be tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:49.502017 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f6fc05fc-1357-426e-b84a-582776a590be tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:49.502695 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f6fc05fc-1357-426e-b84a-582776a590be tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:49.503635 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f6fc05fc-1357-426e-b84a-582776a590be tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:49.504221 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f6fc05fc-1357-426e-b84a-582776a590be tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:49.758994 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-f6fc05fc-1357-426e-b84a-582776a590be tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:49.774371 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-f6fc05fc-1357-426e-b84a-582776a590be tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:49.775864 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-f6fc05fc-1357-426e-b84a-582776a590be tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:49.777074 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-f6fc05fc-1357-426e-b84a-582776a590be tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356" status: 200 len: 1739 microversion: 2.20 time: 0.286309 Jul 05 13:06:49.780306 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 376/755] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:06:49 2022] GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356 => generated 1739 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:06:49.919750 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [req-6be52842-ebc6-46eb-bbb7-add7d593edbd req-f59e2167-1b9f-47df-b5c9-db8097ab8b00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42411ae1-103e-4934-9594-aaf06cc8a356", "name": "network-vif-plugged", "status": "completed", "tag": "0eb7994b-94fe-4d89-a3c9-6b498bab0720"}]} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:06:49.932376 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-6be52842-ebc6-46eb-bbb7-add7d593edbd req-f59e2167-1b9f-47df-b5c9-db8097ab8b00 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:49.932854 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-6be52842-ebc6-46eb-bbb7-add7d593edbd req-f59e2167-1b9f-47df-b5c9-db8097ab8b00 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:49.963365 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.compute.server_external_events [req-6be52842-ebc6-46eb-bbb7-add7d593edbd req-f59e2167-1b9f-47df-b5c9-db8097ab8b00 service nova] Creating event network-vif-plugged:0eb7994b-94fe-4d89-a3c9-6b498bab0720 for instance 42411ae1-103e-4934-9594-aaf06cc8a356 on hv-cinder-79760 Jul 05 13:06:49.970372 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [req-6be52842-ebc6-46eb-bbb7-add7d593edbd req-f59e2167-1b9f-47df-b5c9-db8097ab8b00 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128864 Jul 05 13:06:49.973086 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 380/756] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:06:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:06:50.191360 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-6c59551b-3d54-41c4-8707-b9213d514fca tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:50.192249 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-6c59551b-3d54-41c4-8707-b9213d514fca tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] [instance: 58708391-4350-4b7e-8616-f3f3534bd2e6] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:50.200098 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6c59551b-3d54-41c4-8707-b9213d514fca tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:50.200761 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6c59551b-3d54-41c4-8707-b9213d514fca tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:50.201723 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6c59551b-3d54-41c4-8707-b9213d514fca tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:50.202365 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6c59551b-3d54-41c4-8707-b9213d514fca tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:50.371994 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-6c59551b-3d54-41c4-8707-b9213d514fca tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf000835f1f48cca0a46b233e52c8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec699c3dd1ab470c8cc0685e6e9f766a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:50.386253 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-6c59551b-3d54-41c4-8707-b9213d514fca tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] 10.222.0.36 "GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6" status: 200 len: 1510 microversion: 2.1 time: 0.192888 Jul 05 13:06:50.397840 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 377/757] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:06:50 2022] GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6 => generated 1510 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:06:50.404880 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-ef8c90c2-3d93-408a-a564-6c7003cf82d6 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:06:50.413951 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-ef8c90c2-3d93-408a-a564-6c7003cf82d6 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] [instance: 58708391-4350-4b7e-8616-f3f3534bd2e6] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:50.427074 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ef8c90c2-3d93-408a-a564-6c7003cf82d6 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:50.427454 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ef8c90c2-3d93-408a-a564-6c7003cf82d6 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:50.428533 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ef8c90c2-3d93-408a-a564-6c7003cf82d6 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:50.428785 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ef8c90c2-3d93-408a-a564-6c7003cf82d6 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:50.682558 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-ef8c90c2-3d93-408a-a564-6c7003cf82d6 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] 10.222.0.36 "POST /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6/action" status: 202 len: 0 microversion: 2.1 time: 0.282195 Jul 05 13:06:50.699969 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 381/758] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Jul 5 13:06:50 2022] POST /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 13:06:50.705771 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-d2ed3e37-6c7c-43d9-a888-b184a8794fe4 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:50.706385 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-d2ed3e37-6c7c-43d9-a888-b184a8794fe4 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] [instance: 58708391-4350-4b7e-8616-f3f3534bd2e6] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:50.720013 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d2ed3e37-6c7c-43d9-a888-b184a8794fe4 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:50.722246 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d2ed3e37-6c7c-43d9-a888-b184a8794fe4 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:50.723891 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d2ed3e37-6c7c-43d9-a888-b184a8794fe4 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:50.726503 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d2ed3e37-6c7c-43d9-a888-b184a8794fe4 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:50.795693 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-a47d199c-94e3-4985-981f-3cacd6af2a3e tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:50.796876 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-a47d199c-94e3-4985-981f-3cacd6af2a3e tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:50.808886 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a47d199c-94e3-4985-981f-3cacd6af2a3e tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:50.810033 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a47d199c-94e3-4985-981f-3cacd6af2a3e tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:50.812251 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a47d199c-94e3-4985-981f-3cacd6af2a3e tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:50.812892 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a47d199c-94e3-4985-981f-3cacd6af2a3e tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:51.119390 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-d2ed3e37-6c7c-43d9-a888-b184a8794fe4 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf000835f1f48cca0a46b233e52c8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec699c3dd1ab470c8cc0685e6e9f766a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:51.132283 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-d2ed3e37-6c7c-43d9-a888-b184a8794fe4 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] 10.222.0.36 "GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6" status: 200 len: 1518 microversion: 2.1 time: 0.432006 Jul 05 13:06:51.145575 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 378/759] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:06:50 2022] GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6 => generated 1518 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:06:51.190188 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-a47d199c-94e3-4985-981f-3cacd6af2a3e tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:51.194610 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-a47d199c-94e3-4985-981f-3cacd6af2a3e tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:51.201727 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-a47d199c-94e3-4985-981f-3cacd6af2a3e tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:51.204485 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-a47d199c-94e3-4985-981f-3cacd6af2a3e tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356" status: 200 len: 1739 microversion: 2.20 time: 0.412657 Jul 05 13:06:51.207107 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 382/760] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:06:50 2022] GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356 => generated 1739 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 13:06:52.186807 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-342c57fb-4449-45d4-a0d1-395230586988 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:52.186807 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-342c57fb-4449-45d4-a0d1-395230586988 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] [instance: 58708391-4350-4b7e-8616-f3f3534bd2e6] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:52.186807 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-342c57fb-4449-45d4-a0d1-395230586988 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:52.186807 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-342c57fb-4449-45d4-a0d1-395230586988 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:52.187514 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-342c57fb-4449-45d4-a0d1-395230586988 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:52.187514 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-342c57fb-4449-45d4-a0d1-395230586988 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:52.229575 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-dc8d9937-2796-4347-a37b-145bdab779e8 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:52.230487 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-dc8d9937-2796-4347-a37b-145bdab779e8 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:52.237803 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-dc8d9937-2796-4347-a37b-145bdab779e8 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:52.238309 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-dc8d9937-2796-4347-a37b-145bdab779e8 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:52.239313 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-dc8d9937-2796-4347-a37b-145bdab779e8 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:52.239662 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-dc8d9937-2796-4347-a37b-145bdab779e8 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:52.330422 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-342c57fb-4449-45d4-a0d1-395230586988 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf000835f1f48cca0a46b233e52c8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec699c3dd1ab470c8cc0685e6e9f766a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:52.338644 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-342c57fb-4449-45d4-a0d1-395230586988 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] 10.222.0.36 "GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6" status: 200 len: 1518 microversion: 2.1 time: 0.190559 Jul 05 13:06:52.339209 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 379/761] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:06:52 2022] GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6 => generated 1518 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:06:52.393141 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-dc8d9937-2796-4347-a37b-145bdab779e8 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:52.401676 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-dc8d9937-2796-4347-a37b-145bdab779e8 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:52.403175 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-dc8d9937-2796-4347-a37b-145bdab779e8 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:52.404326 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-dc8d9937-2796-4347-a37b-145bdab779e8 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356" status: 200 len: 1739 microversion: 2.20 time: 0.179375 Jul 05 13:06:52.405129 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 383/762] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:06:52 2022] GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356 => generated 1739 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 13:06:53.356526 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-87fba109-653f-46a3-85b0-80954b8b6c6e tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:53.357160 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-87fba109-653f-46a3-85b0-80954b8b6c6e tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] [instance: 58708391-4350-4b7e-8616-f3f3534bd2e6] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:53.364279 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-87fba109-653f-46a3-85b0-80954b8b6c6e tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:53.364930 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-87fba109-653f-46a3-85b0-80954b8b6c6e tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:53.370239 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-87fba109-653f-46a3-85b0-80954b8b6c6e tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:53.370239 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-87fba109-653f-46a3-85b0-80954b8b6c6e tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:53.423950 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-6d29dd25-9a92-4f73-9124-cb594cfeee49 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:53.424565 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-6d29dd25-9a92-4f73-9124-cb594cfeee49 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:53.437103 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-6d29dd25-9a92-4f73-9124-cb594cfeee49 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:53.437557 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-6d29dd25-9a92-4f73-9124-cb594cfeee49 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:53.441882 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-6d29dd25-9a92-4f73-9124-cb594cfeee49 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:53.442855 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-6d29dd25-9a92-4f73-9124-cb594cfeee49 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:53.643553 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-87fba109-653f-46a3-85b0-80954b8b6c6e tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf000835f1f48cca0a46b233e52c8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec699c3dd1ab470c8cc0685e6e9f766a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:53.676263 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-87fba109-653f-46a3-85b0-80954b8b6c6e tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] 10.222.0.36 "GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6" status: 200 len: 1520 microversion: 2.1 time: 0.317382 Jul 05 13:06:53.676263 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 380/763] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:06:53 2022] GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6 => generated 1520 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:06:53.676697 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-6d29dd25-9a92-4f73-9124-cb594cfeee49 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:53.688551 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-6d29dd25-9a92-4f73-9124-cb594cfeee49 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:53.690221 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-6d29dd25-9a92-4f73-9124-cb594cfeee49 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:53.691729 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-6d29dd25-9a92-4f73-9124-cb594cfeee49 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356" status: 200 len: 1739 microversion: 2.20 time: 0.272921 Jul 05 13:06:53.692768 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 384/764] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:06:53 2022] GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356 => generated 1739 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:06:53.737938 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-455b905b-ccf7-4392-8211-184caf4bc297 req-be02c11b-c73e-4627-a802-1e6b0af8f863 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58708391-4350-4b7e-8616-f3f3534bd2e6", "name": "network-vif-unplugged", "status": "completed", "tag": "dea25a3b-1daa-482f-9f40-46b326121051"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:06:53.746932 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-455b905b-ccf7-4392-8211-184caf4bc297 req-be02c11b-c73e-4627-a802-1e6b0af8f863 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:53.747426 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-455b905b-ccf7-4392-8211-184caf4bc297 req-be02c11b-c73e-4627-a802-1e6b0af8f863 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:53.764474 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.compute.server_external_events [req-455b905b-ccf7-4392-8211-184caf4bc297 req-be02c11b-c73e-4627-a802-1e6b0af8f863 service nova] Unable to find a host for instance 58708391-4350-4b7e-8616-f3f3534bd2e6. Dropping event network-vif-unplugged {{(pid=118387) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 05 13:06:53.765471 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-455b905b-ccf7-4392-8211-184caf4bc297 req-be02c11b-c73e-4627-a802-1e6b0af8f863 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032580 Jul 05 13:06:53.769808 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 381/765] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:06:53 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 38 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 05 13:06:54.692657 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-fbf5521d-78cc-4e71-b710-54dfaf55c0d0 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:54.694582 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-fbf5521d-78cc-4e71-b710-54dfaf55c0d0 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] [instance: 58708391-4350-4b7e-8616-f3f3534bd2e6] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:54.703130 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-fbf5521d-78cc-4e71-b710-54dfaf55c0d0 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:54.703792 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-fbf5521d-78cc-4e71-b710-54dfaf55c0d0 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:54.704851 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-fbf5521d-78cc-4e71-b710-54dfaf55c0d0 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:54.705369 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-fbf5521d-78cc-4e71-b710-54dfaf55c0d0 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:54.712060 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-384da545-c942-4988-b17b-752946877e1d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:54.712753 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-384da545-c942-4988-b17b-752946877e1d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:54.723678 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-384da545-c942-4988-b17b-752946877e1d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:54.724446 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-384da545-c942-4988-b17b-752946877e1d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:54.731110 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-384da545-c942-4988-b17b-752946877e1d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:54.732052 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-384da545-c942-4988-b17b-752946877e1d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:54.998967 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-384da545-c942-4988-b17b-752946877e1d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:55.012065 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-384da545-c942-4988-b17b-752946877e1d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:55.018672 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-384da545-c942-4988-b17b-752946877e1d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:55.020825 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-384da545-c942-4988-b17b-752946877e1d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356" status: 200 len: 1739 microversion: 2.20 time: 0.313327 Jul 05 13:06:55.022510 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 382/766] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:06:54 2022] GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356 => generated 1739 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:06:55.023416 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-fbf5521d-78cc-4e71-b710-54dfaf55c0d0 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf000835f1f48cca0a46b233e52c8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec699c3dd1ab470c8cc0685e6e9f766a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:55.040875 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-fbf5521d-78cc-4e71-b710-54dfaf55c0d0 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] 10.222.0.36 "GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6" status: 200 len: 1576 microversion: 2.1 time: 0.353014 Jul 05 13:06:55.045502 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 385/767] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:06:54 2022] GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6 => generated 1576 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:06:56.040684 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-0a2f2845-0b6f-4cce-b607-5dcdca88f025 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:56.041376 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-0a2f2845-0b6f-4cce-b607-5dcdca88f025 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:56.051835 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0a2f2845-0b6f-4cce-b607-5dcdca88f025 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:56.052265 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0a2f2845-0b6f-4cce-b607-5dcdca88f025 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:56.053332 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0a2f2845-0b6f-4cce-b607-5dcdca88f025 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:56.053784 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0a2f2845-0b6f-4cce-b607-5dcdca88f025 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:56.063159 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-30964207-810c-4c7c-800b-abc565a5c3d9 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:56.064474 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-30964207-810c-4c7c-800b-abc565a5c3d9 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] [instance: 58708391-4350-4b7e-8616-f3f3534bd2e6] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:56.071502 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-30964207-810c-4c7c-800b-abc565a5c3d9 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:56.071944 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-30964207-810c-4c7c-800b-abc565a5c3d9 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:56.072881 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-30964207-810c-4c7c-800b-abc565a5c3d9 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:56.073335 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-30964207-810c-4c7c-800b-abc565a5c3d9 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:56.271599 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-0a2f2845-0b6f-4cce-b607-5dcdca88f025 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:56.282266 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-0a2f2845-0b6f-4cce-b607-5dcdca88f025 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:56.283780 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-0a2f2845-0b6f-4cce-b607-5dcdca88f025 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:56.285213 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-0a2f2845-0b6f-4cce-b607-5dcdca88f025 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356" status: 200 len: 1739 microversion: 2.20 time: 0.249301 Jul 05 13:06:56.285938 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 383/768] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:06:56 2022] GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356 => generated 1739 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:06:56.286054 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-30964207-810c-4c7c-800b-abc565a5c3d9 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf000835f1f48cca0a46b233e52c8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec699c3dd1ab470c8cc0685e6e9f766a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:56.293792 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-30964207-810c-4c7c-800b-abc565a5c3d9 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] 10.222.0.36 "GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6" status: 200 len: 1576 microversion: 2.1 time: 0.234408 Jul 05 13:06:56.294817 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 386/769] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:06:56 2022] GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6 => generated 1576 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:06:57.304977 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-dd34b476-2904-4d4e-9dba-73ee0a42d144 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:57.317515 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-dd34b476-2904-4d4e-9dba-73ee0a42d144 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:57.317697 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-a50b6c27-66a5-4518-8eb2-149670839628 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:57.318192 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-a50b6c27-66a5-4518-8eb2-149670839628 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] [instance: 58708391-4350-4b7e-8616-f3f3534bd2e6] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:57.326343 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-dd34b476-2904-4d4e-9dba-73ee0a42d144 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:57.326984 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-dd34b476-2904-4d4e-9dba-73ee0a42d144 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:57.328064 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-dd34b476-2904-4d4e-9dba-73ee0a42d144 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:57.328747 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-dd34b476-2904-4d4e-9dba-73ee0a42d144 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:57.332742 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a50b6c27-66a5-4518-8eb2-149670839628 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:57.333212 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a50b6c27-66a5-4518-8eb2-149670839628 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:57.334009 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a50b6c27-66a5-4518-8eb2-149670839628 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:57.334969 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a50b6c27-66a5-4518-8eb2-149670839628 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:57.606200 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-dd34b476-2904-4d4e-9dba-73ee0a42d144 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:57.612054 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell1:SELECT=100 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:06:57.636937 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-dd34b476-2904-4d4e-9dba-73ee0a42d144 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:57.638749 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-dd34b476-2904-4d4e-9dba-73ee0a42d144 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:57.640161 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-dd34b476-2904-4d4e-9dba-73ee0a42d144 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356" status: 200 len: 1739 microversion: 2.20 time: 0.340771 Jul 05 13:06:57.645559 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 384/770] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:06:57 2022] GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356 => generated 1739 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:06:57.702957 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-a50b6c27-66a5-4518-8eb2-149670839628 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf000835f1f48cca0a46b233e52c8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec699c3dd1ab470c8cc0685e6e9f766a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:57.719089 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-a50b6c27-66a5-4518-8eb2-149670839628 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] 10.222.0.36 "GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6" status: 200 len: 1576 microversion: 2.1 time: 0.410782 Jul 05 13:06:57.724623 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 387/771] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:06:57 2022] GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6 => generated 1576 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:06:58.665398 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-b2f173d9-cb35-4623-866e-0deee47e26ae tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:58.684339 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-b2f173d9-cb35-4623-866e-0deee47e26ae tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:58.684339 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b2f173d9-cb35-4623-866e-0deee47e26ae tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:58.684339 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b2f173d9-cb35-4623-866e-0deee47e26ae tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:58.684339 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b2f173d9-cb35-4623-866e-0deee47e26ae tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:58.685027 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b2f173d9-cb35-4623-866e-0deee47e26ae tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:58.739285 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-c2fc0c1f-ed37-4b09-af55-0ebe89748713 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:06:58.740657 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-c2fc0c1f-ed37-4b09-af55-0ebe89748713 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] [instance: 58708391-4350-4b7e-8616-f3f3534bd2e6] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:06:58.751895 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-c2fc0c1f-ed37-4b09-af55-0ebe89748713 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:58.757065 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-c2fc0c1f-ed37-4b09-af55-0ebe89748713 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:58.758157 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-c2fc0c1f-ed37-4b09-af55-0ebe89748713 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:06:58.758766 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-c2fc0c1f-ed37-4b09-af55-0ebe89748713 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:06:59.037858 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-b2f173d9-cb35-4623-866e-0deee47e26ae tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:59.054117 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-b2f173d9-cb35-4623-866e-0deee47e26ae tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:59.058716 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-b2f173d9-cb35-4623-866e-0deee47e26ae tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:59.064445 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-b2f173d9-cb35-4623-866e-0deee47e26ae tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356" status: 200 len: 1739 microversion: 2.20 time: 0.402151 Jul 05 13:06:59.070316 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 385/772] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:06:58 2022] GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356 => generated 1739 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:06:59.103880 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-c2fc0c1f-ed37-4b09-af55-0ebe89748713 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf000835f1f48cca0a46b233e52c8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec699c3dd1ab470c8cc0685e6e9f766a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:06:59.116278 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-c2fc0c1f-ed37-4b09-af55-0ebe89748713 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] 10.222.0.36 "GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6" status: 200 len: 1576 microversion: 2.1 time: 0.380697 Jul 05 13:06:59.117077 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 388/773] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:06:58 2022] GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6 => generated 1576 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:07:00.089216 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-707babf9-d42d-45fd-b3ac-31f1f0016402 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:00.089859 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-707babf9-d42d-45fd-b3ac-31f1f0016402 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:00.097446 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-707babf9-d42d-45fd-b3ac-31f1f0016402 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:00.098318 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-707babf9-d42d-45fd-b3ac-31f1f0016402 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:00.099050 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-707babf9-d42d-45fd-b3ac-31f1f0016402 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:00.099647 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-707babf9-d42d-45fd-b3ac-31f1f0016402 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:00.136908 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-0aac0d96-1be4-48b9-a7dc-c4f8af80c3ce tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:00.136908 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-0aac0d96-1be4-48b9-a7dc-c4f8af80c3ce tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] [instance: 58708391-4350-4b7e-8616-f3f3534bd2e6] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:00.150100 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-0aac0d96-1be4-48b9-a7dc-c4f8af80c3ce tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:00.150457 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-0aac0d96-1be4-48b9-a7dc-c4f8af80c3ce tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:00.151226 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-0aac0d96-1be4-48b9-a7dc-c4f8af80c3ce tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:00.151655 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-0aac0d96-1be4-48b9-a7dc-c4f8af80c3ce tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:00.435830 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-0aac0d96-1be4-48b9-a7dc-c4f8af80c3ce tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf000835f1f48cca0a46b233e52c8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec699c3dd1ab470c8cc0685e6e9f766a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:00.444822 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:07:00.448445 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-0aac0d96-1be4-48b9-a7dc-c4f8af80c3ce tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] 10.222.0.36 "GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6" status: 200 len: 1576 microversion: 2.1 time: 0.318652 Jul 05 13:07:00.460201 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 389/774] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:07:00 2022] GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6 => generated 1576 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:07:00.558879 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-707babf9-d42d-45fd-b3ac-31f1f0016402 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:00.568631 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-707babf9-d42d-45fd-b3ac-31f1f0016402 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:00.570815 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-707babf9-d42d-45fd-b3ac-31f1f0016402 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:00.572444 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-707babf9-d42d-45fd-b3ac-31f1f0016402 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356" status: 200 len: 1739 microversion: 2.20 time: 0.488259 Jul 05 13:07:00.573626 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 386/775] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:07:00 2022] GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356 => generated 1739 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:07:01.466142 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-7a8302fa-0ca0-4072-96c6-0fc2687e1861 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:01.466782 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-7a8302fa-0ca0-4072-96c6-0fc2687e1861 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] [instance: 58708391-4350-4b7e-8616-f3f3534bd2e6] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:01.473622 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7a8302fa-0ca0-4072-96c6-0fc2687e1861 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:01.474008 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7a8302fa-0ca0-4072-96c6-0fc2687e1861 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:01.474816 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7a8302fa-0ca0-4072-96c6-0fc2687e1861 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:01.475396 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7a8302fa-0ca0-4072-96c6-0fc2687e1861 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:01.554646 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-45c6d20a-0316-48a2-ad55-5e91ebab1eed tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Action: 'create', calling method: .version_select at 0x7f70de67d670>, body: {"keypair": {"name": "tempest-keypair-110555287", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPe+DP4pwJMxDxuvpzvesrQuGE//UIU+Z3Y9YNHcaT4/J+U64iYMp4tAeFeOW5jrBUTTLDlaxklaGZ1xa0YnDC4G194gnpnXR33oooduWHP9FL5MYmTTeEHAUe8FaAfWrg=="}} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:07:01.571732 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.quota [None req-45c6d20a-0316-48a2-ad55-5e91ebab1eed tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Getting quotas for project a9e9afdc843646768800da2ede466298. Resources: {'key_pairs'} {{(pid=118386) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 13:07:01.576374 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.quota [None req-45c6d20a-0316-48a2-ad55-5e91ebab1eed tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Getting quotas for user 15ce49dfe7d0401caa1784c35b2ef90e and project a9e9afdc843646768800da2ede466298. Resources: {'key_pairs'} {{(pid=118386) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 13:07:01.619958 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-7a8302fa-0ca0-4072-96c6-0fc2687e1861 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf000835f1f48cca0a46b233e52c8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec699c3dd1ab470c8cc0685e6e9f766a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:01.628058 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-7a8302fa-0ca0-4072-96c6-0fc2687e1861 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] 10.222.0.36 "GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6" status: 200 len: 1576 microversion: 2.1 time: 0.166027 Jul 05 13:07:01.635070 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 387/776] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:07:01 2022] GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6 => generated 1576 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:07:01.640024 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-c9788796-3b63-433e-a545-57effcd0d2a7 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:01.640531 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-c9788796-3b63-433e-a545-57effcd0d2a7 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:01.647677 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c9788796-3b63-433e-a545-57effcd0d2a7 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:01.648166 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c9788796-3b63-433e-a545-57effcd0d2a7 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:01.649051 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c9788796-3b63-433e-a545-57effcd0d2a7 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:01.649409 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c9788796-3b63-433e-a545-57effcd0d2a7 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:01.723028 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-45c6d20a-0316-48a2-ad55-5e91ebab1eed tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.296113 Jul 05 13:07:01.723028 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 390/777] 10.222.0.36 () {60 vars in 1158 bytes} [Tue Jul 5 13:07:01 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:07:01.810403 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-c9788796-3b63-433e-a545-57effcd0d2a7 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:01.826623 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-c9788796-3b63-433e-a545-57effcd0d2a7 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:01.828390 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-c9788796-3b63-433e-a545-57effcd0d2a7 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:01.829665 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-c9788796-3b63-433e-a545-57effcd0d2a7 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356" status: 200 len: 1739 microversion: 2.20 time: 0.193540 Jul 05 13:07:01.830357 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 388/778] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:07:01 2022] GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356 => generated 1739 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:07:02.645699 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-f23a6db2-e1a3-49d0-8490-424bc95a7b7b tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:02.646429 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-f23a6db2-e1a3-49d0-8490-424bc95a7b7b tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] [instance: 58708391-4350-4b7e-8616-f3f3534bd2e6] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:02.654195 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f23a6db2-e1a3-49d0-8490-424bc95a7b7b tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:02.654633 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f23a6db2-e1a3-49d0-8490-424bc95a7b7b tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:02.655394 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f23a6db2-e1a3-49d0-8490-424bc95a7b7b tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:02.656085 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f23a6db2-e1a3-49d0-8490-424bc95a7b7b tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:02.826028 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-f23a6db2-e1a3-49d0-8490-424bc95a7b7b tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf000835f1f48cca0a46b233e52c8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec699c3dd1ab470c8cc0685e6e9f766a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:02.838951 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-f23a6db2-e1a3-49d0-8490-424bc95a7b7b tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] 10.222.0.36 "GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6" status: 200 len: 1576 microversion: 2.1 time: 0.196957 Jul 05 13:07:02.839453 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 391/779] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:07:02 2022] GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6 => generated 1576 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:07:02.859047 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-0ad722f7-36ab-450e-85d1-c1e3daf123a0 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:02.864235 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-0ad722f7-36ab-450e-85d1-c1e3daf123a0 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:02.869650 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0ad722f7-36ab-450e-85d1-c1e3daf123a0 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:02.870444 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0ad722f7-36ab-450e-85d1-c1e3daf123a0 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:02.871483 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0ad722f7-36ab-450e-85d1-c1e3daf123a0 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:02.872078 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0ad722f7-36ab-450e-85d1-c1e3daf123a0 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:03.047580 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-0ad722f7-36ab-450e-85d1-c1e3daf123a0 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:03.057337 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-0ad722f7-36ab-450e-85d1-c1e3daf123a0 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:03.058856 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-0ad722f7-36ab-450e-85d1-c1e3daf123a0 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:03.060050 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-0ad722f7-36ab-450e-85d1-c1e3daf123a0 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356" status: 200 len: 1721 microversion: 2.20 time: 0.207463 Jul 05 13:07:03.060837 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 389/780] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:07:02 2022] GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356 => generated 1721 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:07:03.855564 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-d4d09f07-31ed-417c-91d2-85b84a449ce2 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:03.856316 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-d4d09f07-31ed-417c-91d2-85b84a449ce2 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] [instance: 58708391-4350-4b7e-8616-f3f3534bd2e6] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:03.862817 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-d4d09f07-31ed-417c-91d2-85b84a449ce2 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:03.863362 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-d4d09f07-31ed-417c-91d2-85b84a449ce2 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:03.864124 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-d4d09f07-31ed-417c-91d2-85b84a449ce2 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:03.864557 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-d4d09f07-31ed-417c-91d2-85b84a449ce2 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:04.078186 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-d4d09f07-31ed-417c-91d2-85b84a449ce2 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf000835f1f48cca0a46b233e52c8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec699c3dd1ab470c8cc0685e6e9f766a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:04.079288 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-f548bde6-5eba-44ae-8078-29ac2fee7b1f tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:04.080663 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-f548bde6-5eba-44ae-8078-29ac2fee7b1f tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:04.086065 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-d4d09f07-31ed-417c-91d2-85b84a449ce2 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] 10.222.0.36 "GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6" status: 200 len: 1576 microversion: 2.1 time: 0.234696 Jul 05 13:07:04.086635 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 392/781] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:07:03 2022] GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6 => generated 1576 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:07:04.094766 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f548bde6-5eba-44ae-8078-29ac2fee7b1f tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:04.094766 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f548bde6-5eba-44ae-8078-29ac2fee7b1f tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:04.094766 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f548bde6-5eba-44ae-8078-29ac2fee7b1f tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:04.094766 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f548bde6-5eba-44ae-8078-29ac2fee7b1f tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:04.224724 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-f548bde6-5eba-44ae-8078-29ac2fee7b1f tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:04.234073 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-f548bde6-5eba-44ae-8078-29ac2fee7b1f tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:04.235598 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-f548bde6-5eba-44ae-8078-29ac2fee7b1f tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:04.254520 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-f548bde6-5eba-44ae-8078-29ac2fee7b1f tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356" status: 200 len: 1721 microversion: 2.20 time: 0.161414 Jul 05 13:07:04.254520 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 390/782] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:07:04 2022] GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 13:07:04.729173 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-7ae06d72-66ec-4d44-b4f9-65a0822d49eb tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-522311294", "imageRef": "d6134305-a5c0-4d2c-afc8-e54be21f685c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bec97ac2-609f-4a75-a848-802e6f109c92"}], "security_groups": [{"name": "tempest-securitygroup--860257462"}], "key_name": "tempest-keypair-110555287", "user_data": "}} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:07:04.853038 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.network.neutron [None req-7ae06d72-66ec-4d44-b4f9-65a0822d49eb tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] validate_networks() for [('bec97ac2-609f-4a75-a848-802e6f109c92', None, None, None, None, None)] {{(pid=118386) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 13:07:05.102661 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-4e39740a-5f3f-4c05-ba13-7ecd3deb908b tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:05.103924 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-4e39740a-5f3f-4c05-ba13-7ecd3deb908b tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] [instance: 58708391-4350-4b7e-8616-f3f3534bd2e6] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:05.111515 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4e39740a-5f3f-4c05-ba13-7ecd3deb908b tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:05.119052 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4e39740a-5f3f-4c05-ba13-7ecd3deb908b tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:05.120202 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4e39740a-5f3f-4c05-ba13-7ecd3deb908b tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:05.121997 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4e39740a-5f3f-4c05-ba13-7ecd3deb908b tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:05.385090 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-4e39740a-5f3f-4c05-ba13-7ecd3deb908b tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf000835f1f48cca0a46b233e52c8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec699c3dd1ab470c8cc0685e6e9f766a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:05.394200 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-4e39740a-5f3f-4c05-ba13-7ecd3deb908b tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] 10.222.0.36 "GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6" status: 200 len: 1576 microversion: 2.1 time: 0.294796 Jul 05 13:07:05.394890 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 391/783] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:07:05 2022] GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6 => generated 1576 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:07:05.401023 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-7416ac06-05fb-4767-b9ff-3dbba97bf39a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:05.401666 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-7416ac06-05fb-4767-b9ff-3dbba97bf39a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:05.401826 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.virt.hardware [None req-7ae06d72-66ec-4d44-b4f9-65a0822d49eb tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Flavor limits 0:0:0 {{(pid=118386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 13:07:05.407832 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7416ac06-05fb-4767-b9ff-3dbba97bf39a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:05.408286 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7416ac06-05fb-4767-b9ff-3dbba97bf39a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:05.409098 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7416ac06-05fb-4767-b9ff-3dbba97bf39a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:05.409227 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.virt.hardware [None req-7ae06d72-66ec-4d44-b4f9-65a0822d49eb tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Image limits 0:0:0 {{(pid=118386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 13:07:05.409537 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7416ac06-05fb-4767-b9ff-3dbba97bf39a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:05.409728 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.virt.hardware [None req-7ae06d72-66ec-4d44-b4f9-65a0822d49eb tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Flavor pref 0:0:0 {{(pid=118386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 13:07:05.410111 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.virt.hardware [None req-7ae06d72-66ec-4d44-b4f9-65a0822d49eb tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Image pref 0:0:0 {{(pid=118386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 13:07:05.410526 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.virt.hardware [None req-7ae06d72-66ec-4d44-b4f9-65a0822d49eb tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 13:07:05.420937 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-7ae06d72-66ec-4d44-b4f9-65a0822d49eb tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:05.421639 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-7ae06d72-66ec-4d44-b4f9-65a0822d49eb tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:05.422612 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-7ae06d72-66ec-4d44-b4f9-65a0822d49eb tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:05.423286 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-7ae06d72-66ec-4d44-b4f9-65a0822d49eb tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:05.443585 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.quota [None req-7ae06d72-66ec-4d44-b4f9-65a0822d49eb tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Getting quotas for project a9e9afdc843646768800da2ede466298. Resources: {'instances', 'cores', 'ram'} {{(pid=118386) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 13:07:05.448068 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.quota [None req-7ae06d72-66ec-4d44-b4f9-65a0822d49eb tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Getting quotas for user 15ce49dfe7d0401caa1784c35b2ef90e and project a9e9afdc843646768800da2ede466298. Resources: {'instances', 'cores', 'ram'} {{(pid=118386) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 13:07:05.464007 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-7ae06d72-66ec-4d44-b4f9-65a0822d49eb tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Going to run 1 instances... {{(pid=118386) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 13:07:05.469701 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-7ae06d72-66ec-4d44-b4f9-65a0822d49eb tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d6134305-a5c0-4d2c-afc8-e54be21f685c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118386) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 13:07:05.562432 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-7416ac06-05fb-4767-b9ff-3dbba97bf39a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:05.571418 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-7416ac06-05fb-4767-b9ff-3dbba97bf39a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:05.573117 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-7416ac06-05fb-4767-b9ff-3dbba97bf39a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:05.574516 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-7416ac06-05fb-4767-b9ff-3dbba97bf39a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356" status: 200 len: 1724 microversion: 2.20 time: 0.178003 Jul 05 13:07:05.575183 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 392/784] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:07:05 2022] GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:07:05.599483 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-7ae06d72-66ec-4d44-b4f9-65a0822d49eb tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.878144 Jul 05 13:07:05.600949 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-b192bd50-ad4d-42b9-a59e-14193c9fbd4c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "383623d2-2808-4fc8-8809-f767ae3a4b97"}} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:07:05.602247 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-b192bd50-ad4d-42b9-a59e-14193c9fbd4c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:05.607043 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 393/785] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jul 5 13:07:04 2022] POST /compute/v2.1/servers => generated 401 bytes in 886 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 05 13:07:05.609434 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b192bd50-ad4d-42b9-a59e-14193c9fbd4c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:05.610202 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b192bd50-ad4d-42b9-a59e-14193c9fbd4c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:05.611155 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b192bd50-ad4d-42b9-a59e-14193c9fbd4c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:05.611757 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b192bd50-ad4d-42b9-a59e-14193c9fbd4c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:05.616974 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-d1d82449-215e-4013-b1df-08abae26f397 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:05.617632 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-d1d82449-215e-4013-b1df-08abae26f397 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:05.703073 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-d1d82449-215e-4013-b1df-08abae26f397 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:05.710529 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-d1d82449-215e-4013-b1df-08abae26f397 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25" status: 200 len: 1236 microversion: 2.1 time: 0.102247 Jul 05 13:07:05.716843 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 394/786] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:07:05 2022] GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 => generated 1236 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:07:05.838456 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [req-66fe0d90-b893-45d0-9be8-e2f8ff2c8af8 req-22e8b460-aaba-4f9d-adde-eb27bf35a553 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58708391-4350-4b7e-8616-f3f3534bd2e6", "name": "network-vif-plugged", "status": "completed", "tag": "dea25a3b-1daa-482f-9f40-46b326121051"}]} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:07:05.862097 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-66fe0d90-b893-45d0-9be8-e2f8ff2c8af8 req-22e8b460-aaba-4f9d-adde-eb27bf35a553 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:05.862556 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-66fe0d90-b893-45d0-9be8-e2f8ff2c8af8 req-22e8b460-aaba-4f9d-adde-eb27bf35a553 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:05.887118 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.compute.server_external_events [req-66fe0d90-b893-45d0-9be8-e2f8ff2c8af8 req-22e8b460-aaba-4f9d-adde-eb27bf35a553 service nova] Creating event network-vif-plugged:dea25a3b-1daa-482f-9f40-46b326121051 for instance 58708391-4350-4b7e-8616-f3f3534bd2e6 on hv-cinder-79760 Jul 05 13:07:05.892800 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [req-66fe0d90-b893-45d0-9be8-e2f8ff2c8af8 req-22e8b460-aaba-4f9d-adde-eb27bf35a553 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059648 Jul 05 13:07:05.893772 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 395/787] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:07:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 13:07:06.411808 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-f0b5672e-d9e2-4650-a343-738e15f72e51 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:06.413395 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-f0b5672e-d9e2-4650-a343-738e15f72e51 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] [instance: 58708391-4350-4b7e-8616-f3f3534bd2e6] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:06.420218 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f0b5672e-d9e2-4650-a343-738e15f72e51 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:06.420694 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f0b5672e-d9e2-4650-a343-738e15f72e51 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:06.421458 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f0b5672e-d9e2-4650-a343-738e15f72e51 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:06.421884 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f0b5672e-d9e2-4650-a343-738e15f72e51 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:06.561460 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-f0b5672e-d9e2-4650-a343-738e15f72e51 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf000835f1f48cca0a46b233e52c8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec699c3dd1ab470c8cc0685e6e9f766a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:06.569766 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-f0b5672e-d9e2-4650-a343-738e15f72e51 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] 10.222.0.36 "GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6" status: 200 len: 1576 microversion: 2.1 time: 0.162138 Jul 05 13:07:06.573624 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 396/788] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:07:06 2022] GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6 => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:07:06.727950 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-7a94329b-f1a4-4b46-8045-6d5b7e3a6acf tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:06.728482 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-7a94329b-f1a4-4b46-8045-6d5b7e3a6acf tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:06.730684 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:07:06.754859 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-b192bd50-ad4d-42b9-a59e-14193c9fbd4c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "POST /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.158490 Jul 05 13:07:06.755488 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 393/789] 10.222.0.36 () {62 vars in 1363 bytes} [Tue Jul 5 13:07:05 2022] POST /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356/os-volume_attachments => generated 188 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 05 13:07:06.783017 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-7a94329b-f1a4-4b46-8045-6d5b7e3a6acf tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:06.791204 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-7a94329b-f1a4-4b46-8045-6d5b7e3a6acf tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25" status: 200 len: 1236 microversion: 2.1 time: 0.067727 Jul 05 13:07:06.792072 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 397/790] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:07:06 2022] GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 => generated 1236 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:07:06.879135 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-b5eb8462-b24c-47e2-ae6c-4b2ea0b06f76 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:06.879633 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-b5eb8462-b24c-47e2-ae6c-4b2ea0b06f76 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:06.886551 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b5eb8462-b24c-47e2-ae6c-4b2ea0b06f76 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:06.887003 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b5eb8462-b24c-47e2-ae6c-4b2ea0b06f76 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:06.887830 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b5eb8462-b24c-47e2-ae6c-4b2ea0b06f76 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:06.888269 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b5eb8462-b24c-47e2-ae6c-4b2ea0b06f76 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:07.514575 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-b5eb8462-b24c-47e2-ae6c-4b2ea0b06f76 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "DELETE /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356/os-volume_attachments/383623d2-2808-4fc8-8809-f767ae3a4b97" status: 202 len: 0 microversion: 2.20 time: 0.639337 Jul 05 13:07:07.515178 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 394/791] 10.222.0.36 () {60 vars in 1456 bytes} [Tue Jul 5 13:07:06 2022] DELETE /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356/os-volume_attachments/383623d2-2808-4fc8-8809-f767ae3a4b97 => generated 0 bytes in 641 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 05 13:07:07.570154 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-19371b6f-1965-46d2-82c4-f75271ae2137 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:07:07.570719 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-19371b6f-1965-46d2-82c4-f75271ae2137 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:07.577810 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-19371b6f-1965-46d2-82c4-f75271ae2137 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:07.578248 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-19371b6f-1965-46d2-82c4-f75271ae2137 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:07.581357 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-19371b6f-1965-46d2-82c4-f75271ae2137 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:07.581357 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-19371b6f-1965-46d2-82c4-f75271ae2137 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:07.586340 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-98bd08ca-1d18-43e2-95a0-d8264894a850 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:07.586957 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-98bd08ca-1d18-43e2-95a0-d8264894a850 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] [instance: 58708391-4350-4b7e-8616-f3f3534bd2e6] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:07.593334 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-98bd08ca-1d18-43e2-95a0-d8264894a850 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:07.593776 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-98bd08ca-1d18-43e2-95a0-d8264894a850 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:07.594541 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-98bd08ca-1d18-43e2-95a0-d8264894a850 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:07.594970 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-98bd08ca-1d18-43e2-95a0-d8264894a850 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:07.728847 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-98bd08ca-1d18-43e2-95a0-d8264894a850 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf000835f1f48cca0a46b233e52c8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec699c3dd1ab470c8cc0685e6e9f766a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:07.736659 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-98bd08ca-1d18-43e2-95a0-d8264894a850 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] 10.222.0.36 "GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6" status: 200 len: 1576 microversion: 2.1 time: 0.154077 Jul 05 13:07:07.737227 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 395/792] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:07:07 2022] GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:07:07.810385 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-b6cea789-02c3-4540-9866-23d15769d980 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:07.811045 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-b6cea789-02c3-4540-9866-23d15769d980 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:07.816978 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b6cea789-02c3-4540-9866-23d15769d980 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:07.817413 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b6cea789-02c3-4540-9866-23d15769d980 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:07.818167 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b6cea789-02c3-4540-9866-23d15769d980 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:07.819165 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b6cea789-02c3-4540-9866-23d15769d980 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:07.833599 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:07:07.879518 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-b6cea789-02c3-4540-9866-23d15769d980 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:07.887909 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-b6cea789-02c3-4540-9866-23d15769d980 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25" status: 200 len: 1232 microversion: 2.1 time: 0.081501 Jul 05 13:07:07.888794 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 396/793] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:07:07 2022] GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 => generated 1232 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:07:07.900768 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-19371b6f-1965-46d2-82c4-f75271ae2137 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "POST /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356/action" status: 202 len: 0 microversion: 2.20 time: 0.333849 Jul 05 13:07:07.904305 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 398/794] 10.222.0.36 () {62 vars in 1318 bytes} [Tue Jul 5 13:07:07 2022] POST /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356/action => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 05 13:07:07.911404 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-f95e78cf-56a4-4f47-91dc-cf579d511e51 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:07.911501 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [req-d64a7878-e129-47a9-b6e0-03c0978fa0f2 req-3edb36fc-2fdd-42b4-bdcd-566c098514e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42411ae1-103e-4934-9594-aaf06cc8a356", "name": "network-vif-unplugged", "status": "completed", "tag": "0eb7994b-94fe-4d89-a3c9-6b498bab0720"}]} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:07:07.911950 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-f95e78cf-56a4-4f47-91dc-cf579d511e51 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:07.920413 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f95e78cf-56a4-4f47-91dc-cf579d511e51 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:07.920875 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-d64a7878-e129-47a9-b6e0-03c0978fa0f2 req-3edb36fc-2fdd-42b4-bdcd-566c098514e5 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:07.920989 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f95e78cf-56a4-4f47-91dc-cf579d511e51 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:07.924341 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-d64a7878-e129-47a9-b6e0-03c0978fa0f2 req-3edb36fc-2fdd-42b4-bdcd-566c098514e5 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:07.924456 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f95e78cf-56a4-4f47-91dc-cf579d511e51 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:07.924456 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f95e78cf-56a4-4f47-91dc-cf579d511e51 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:07.933328 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.compute.server_external_events [req-d64a7878-e129-47a9-b6e0-03c0978fa0f2 req-3edb36fc-2fdd-42b4-bdcd-566c098514e5 service nova] Unable to find a host for instance 42411ae1-103e-4934-9594-aaf06cc8a356. Dropping event network-vif-unplugged {{(pid=118386) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 05 13:07:07.934195 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [req-d64a7878-e129-47a9-b6e0-03c0978fa0f2 req-3edb36fc-2fdd-42b4-bdcd-566c098514e5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026526 Jul 05 13:07:07.934754 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 399/795] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:07:07 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 05 13:07:08.061468 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-f95e78cf-56a4-4f47-91dc-cf579d511e51 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:08.069950 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-f95e78cf-56a4-4f47-91dc-cf579d511e51 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:08.071553 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-f95e78cf-56a4-4f47-91dc-cf579d511e51 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:08.072910 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-f95e78cf-56a4-4f47-91dc-cf579d511e51 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356" status: 200 len: 1672 microversion: 2.20 time: 0.166748 Jul 05 13:07:08.073476 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 397/796] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:07:07 2022] GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356 => generated 1672 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:07:08.755756 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-0c2c6f67-cb63-4236-95e8-b84e37a42027 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:08.757995 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-0c2c6f67-cb63-4236-95e8-b84e37a42027 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] [instance: 58708391-4350-4b7e-8616-f3f3534bd2e6] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:08.768681 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-0c2c6f67-cb63-4236-95e8-b84e37a42027 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:08.769135 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-0c2c6f67-cb63-4236-95e8-b84e37a42027 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:08.769909 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-0c2c6f67-cb63-4236-95e8-b84e37a42027 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:08.770340 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-0c2c6f67-cb63-4236-95e8-b84e37a42027 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:08.905177 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-090c0322-6418-4504-910e-208a3bef960f tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:08.906395 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-090c0322-6418-4504-910e-208a3bef960f tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:08.913706 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-090c0322-6418-4504-910e-208a3bef960f tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:08.914153 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-090c0322-6418-4504-910e-208a3bef960f tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:08.914920 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-090c0322-6418-4504-910e-208a3bef960f tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:08.915987 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-090c0322-6418-4504-910e-208a3bef960f tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:08.919121 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-0c2c6f67-cb63-4236-95e8-b84e37a42027 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf000835f1f48cca0a46b233e52c8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec699c3dd1ab470c8cc0685e6e9f766a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:08.927274 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-0c2c6f67-cb63-4236-95e8-b84e37a42027 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] 10.222.0.36 "GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6" status: 200 len: 1563 microversion: 2.1 time: 0.176286 Jul 05 13:07:08.927848 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 400/797] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:07:08 2022] GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6 => generated 1563 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:07:08.989321 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-090c0322-6418-4504-910e-208a3bef960f tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:08.998990 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-090c0322-6418-4504-910e-208a3bef960f tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25" status: 200 len: 1306 microversion: 2.1 time: 0.097378 Jul 05 13:07:08.999573 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 398/798] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:07:08 2022] GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 => generated 1306 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:07:09.091114 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-a9e85390-08cb-45ee-aae6-a85e12680e50 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:09.091735 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-a9e85390-08cb-45ee-aae6-a85e12680e50 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:09.097843 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a9e85390-08cb-45ee-aae6-a85e12680e50 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:09.098294 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a9e85390-08cb-45ee-aae6-a85e12680e50 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:09.099056 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a9e85390-08cb-45ee-aae6-a85e12680e50 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:09.099519 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a9e85390-08cb-45ee-aae6-a85e12680e50 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:09.232914 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-a9e85390-08cb-45ee-aae6-a85e12680e50 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:09.241277 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-a9e85390-08cb-45ee-aae6-a85e12680e50 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:09.242850 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-a9e85390-08cb-45ee-aae6-a85e12680e50 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:09.244065 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-a9e85390-08cb-45ee-aae6-a85e12680e50 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356" status: 200 len: 1672 microversion: 2.20 time: 0.156930 Jul 05 13:07:09.244804 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 401/799] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:07:09 2022] GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356 => generated 1672 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:07:10.015736 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-8d1f221d-a76d-4386-a295-6848068c0951 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:10.016343 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-8d1f221d-a76d-4386-a295-6848068c0951 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:10.023953 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8d1f221d-a76d-4386-a295-6848068c0951 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:10.024401 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8d1f221d-a76d-4386-a295-6848068c0951 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:10.025326 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8d1f221d-a76d-4386-a295-6848068c0951 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:10.025699 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8d1f221d-a76d-4386-a295-6848068c0951 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:10.170808 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-8d1f221d-a76d-4386-a295-6848068c0951 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:10.178529 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-8d1f221d-a76d-4386-a295-6848068c0951 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25" status: 200 len: 1361 microversion: 2.1 time: 0.166648 Jul 05 13:07:10.179129 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 399/800] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:07:10 2022] GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 => generated 1361 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:07:10.262642 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-cb8e4a7a-fc3e-48b7-87dd-ec2333ba3ac5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:10.263187 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-cb8e4a7a-fc3e-48b7-87dd-ec2333ba3ac5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:10.269565 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-cb8e4a7a-fc3e-48b7-87dd-ec2333ba3ac5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:10.270012 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-cb8e4a7a-fc3e-48b7-87dd-ec2333ba3ac5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:10.270771 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-cb8e4a7a-fc3e-48b7-87dd-ec2333ba3ac5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:10.271199 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-cb8e4a7a-fc3e-48b7-87dd-ec2333ba3ac5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:10.408191 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-cb8e4a7a-fc3e-48b7-87dd-ec2333ba3ac5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:10.416551 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-cb8e4a7a-fc3e-48b7-87dd-ec2333ba3ac5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:10.418073 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-cb8e4a7a-fc3e-48b7-87dd-ec2333ba3ac5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:10.419221 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-cb8e4a7a-fc3e-48b7-87dd-ec2333ba3ac5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356" status: 200 len: 1730 microversion: 2.20 time: 0.160789 Jul 05 13:07:10.419778 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 402/801] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:07:10 2022] GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 13:07:11.085613 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-aeaa30ce-81b6-44b2-8a80-b5ed418d9524 req-ebfedc3f-fa6c-4d3a-9d18-cdd6207ec561 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b55ca313-2e09-4b58-b7e7-cdda74ffdd25", "tag": "10c331f6-aa21-4291-bc1b-87fa3f5495ba"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:07:11.091238 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_api:SELECT=74 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:07:11.095831 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-aeaa30ce-81b6-44b2-8a80-b5ed418d9524 req-ebfedc3f-fa6c-4d3a-9d18-cdd6207ec561 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:11.096352 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-aeaa30ce-81b6-44b2-8a80-b5ed418d9524 req-ebfedc3f-fa6c-4d3a-9d18-cdd6207ec561 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:11.107520 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-aeaa30ce-81b6-44b2-8a80-b5ed418d9524 req-ebfedc3f-fa6c-4d3a-9d18-cdd6207ec561 service nova] Creating event network-changed:10c331f6-aa21-4291-bc1b-87fa3f5495ba for instance b55ca313-2e09-4b58-b7e7-cdda74ffdd25 on hv-cinder-79760 Jul 05 13:07:11.112714 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-aeaa30ce-81b6-44b2-8a80-b5ed418d9524 req-ebfedc3f-fa6c-4d3a-9d18-cdd6207ec561 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032078 Jul 05 13:07:11.113416 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 400/802] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:07:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:07:11.197209 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-f54424b4-04c8-447b-bc9c-fe8d8cda0bb9 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:11.198088 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-f54424b4-04c8-447b-bc9c-fe8d8cda0bb9 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:11.206534 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f54424b4-04c8-447b-bc9c-fe8d8cda0bb9 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:11.207230 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f54424b4-04c8-447b-bc9c-fe8d8cda0bb9 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:11.208272 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f54424b4-04c8-447b-bc9c-fe8d8cda0bb9 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:11.209105 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f54424b4-04c8-447b-bc9c-fe8d8cda0bb9 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:11.360143 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-f54424b4-04c8-447b-bc9c-fe8d8cda0bb9 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:11.369671 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-f54424b4-04c8-447b-bc9c-fe8d8cda0bb9 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25" status: 200 len: 1361 microversion: 2.1 time: 0.178226 Jul 05 13:07:11.379427 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 403/803] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:07:11 2022] GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 => generated 1361 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:07:11.437680 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-48bc3720-55f2-4e48-b9c6-9b92b79c1bf9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:11.438427 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-48bc3720-55f2-4e48-b9c6-9b92b79c1bf9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:11.446191 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-48bc3720-55f2-4e48-b9c6-9b92b79c1bf9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:11.446959 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-48bc3720-55f2-4e48-b9c6-9b92b79c1bf9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:11.447739 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-48bc3720-55f2-4e48-b9c6-9b92b79c1bf9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:11.448175 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-48bc3720-55f2-4e48-b9c6-9b92b79c1bf9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:11.584741 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-48bc3720-55f2-4e48-b9c6-9b92b79c1bf9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:11.592939 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-48bc3720-55f2-4e48-b9c6-9b92b79c1bf9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:11.594524 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-48bc3720-55f2-4e48-b9c6-9b92b79c1bf9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:11.595833 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-48bc3720-55f2-4e48-b9c6-9b92b79c1bf9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356" status: 200 len: 1730 microversion: 2.20 time: 0.162987 Jul 05 13:07:11.596479 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 401/804] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:07:11 2022] GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:07:12.388996 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-8e5ac95a-7081-4d68-90a2-14e18c68d1fb tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:12.390913 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-8e5ac95a-7081-4d68-90a2-14e18c68d1fb tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:12.398695 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-8e5ac95a-7081-4d68-90a2-14e18c68d1fb tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:12.399269 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-8e5ac95a-7081-4d68-90a2-14e18c68d1fb tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:12.400486 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-8e5ac95a-7081-4d68-90a2-14e18c68d1fb tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:12.401257 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-8e5ac95a-7081-4d68-90a2-14e18c68d1fb tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:12.557710 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-8e5ac95a-7081-4d68-90a2-14e18c68d1fb tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:12.565496 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-8e5ac95a-7081-4d68-90a2-14e18c68d1fb tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25" status: 200 len: 1361 microversion: 2.1 time: 0.181406 Jul 05 13:07:12.566629 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 404/805] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:07:12 2022] GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 => generated 1361 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:07:12.615812 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-2099d33c-6d68-46a4-9686-1fef4932c8a8 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:12.617263 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-2099d33c-6d68-46a4-9686-1fef4932c8a8 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:12.631270 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2099d33c-6d68-46a4-9686-1fef4932c8a8 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:12.632608 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2099d33c-6d68-46a4-9686-1fef4932c8a8 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:12.633797 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2099d33c-6d68-46a4-9686-1fef4932c8a8 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:12.634509 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2099d33c-6d68-46a4-9686-1fef4932c8a8 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:12.777531 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-2099d33c-6d68-46a4-9686-1fef4932c8a8 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:12.785700 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-2099d33c-6d68-46a4-9686-1fef4932c8a8 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:12.787388 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-2099d33c-6d68-46a4-9686-1fef4932c8a8 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:12.788797 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-2099d33c-6d68-46a4-9686-1fef4932c8a8 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356" status: 200 len: 1730 microversion: 2.20 time: 0.177953 Jul 05 13:07:12.789430 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 402/806] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:07:12 2022] GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356 => generated 1730 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:07:13.586408 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-d5a19adf-4d3d-4020-a020-0704e423916b tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:13.587040 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-d5a19adf-4d3d-4020-a020-0704e423916b tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:13.593492 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-d5a19adf-4d3d-4020-a020-0704e423916b tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:13.593934 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-d5a19adf-4d3d-4020-a020-0704e423916b tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:13.594687 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-d5a19adf-4d3d-4020-a020-0704e423916b tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:13.595117 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-d5a19adf-4d3d-4020-a020-0704e423916b tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:13.808034 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-cef3cef0-21d2-4a47-a2c5-c3e8dedeacea tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:13.808864 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-cef3cef0-21d2-4a47-a2c5-c3e8dedeacea tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:13.816346 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cef3cef0-21d2-4a47-a2c5-c3e8dedeacea tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:13.816836 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cef3cef0-21d2-4a47-a2c5-c3e8dedeacea tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:13.817785 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cef3cef0-21d2-4a47-a2c5-c3e8dedeacea tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:13.818221 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cef3cef0-21d2-4a47-a2c5-c3e8dedeacea tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:14.012787 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-d5a19adf-4d3d-4020-a020-0704e423916b tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:14.021706 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-d5a19adf-4d3d-4020-a020-0704e423916b tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25" status: 200 len: 1361 microversion: 2.1 time: 0.438566 Jul 05 13:07:14.022484 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 405/807] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:07:13 2022] GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 => generated 1361 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:07:14.028038 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-c704892e-b2b1-4c7d-aa6d-6790d7f54a6e tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:14.028868 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-c704892e-b2b1-4c7d-aa6d-6790d7f54a6e tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 4c6520f9-4cce-44f6-a004-5226841dd52a] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:14.035870 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-c704892e-b2b1-4c7d-aa6d-6790d7f54a6e tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:14.036371 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-c704892e-b2b1-4c7d-aa6d-6790d7f54a6e tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:14.037815 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-c704892e-b2b1-4c7d-aa6d-6790d7f54a6e tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:14.038455 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-c704892e-b2b1-4c7d-aa6d-6790d7f54a6e tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:14.064346 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-c704892e-b2b1-4c7d-aa6d-6790d7f54a6e tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/4c6520f9-4cce-44f6-a004-5226841dd52a/ips" status: 200 len: 149 microversion: 2.1 time: 0.039682 Jul 05 13:07:14.065616 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 406/808] 10.222.0.36 () {58 vars in 1247 bytes} [Tue Jul 5 13:07:14 2022] GET /compute/v2.1/servers/4c6520f9-4cce-44f6-a004-5226841dd52a/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:07:14.076465 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-cef3cef0-21d2-4a47-a2c5-c3e8dedeacea tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:14.086673 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-cef3cef0-21d2-4a47-a2c5-c3e8dedeacea tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:14.089049 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-cef3cef0-21d2-4a47-a2c5-c3e8dedeacea tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:14.090351 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-cef3cef0-21d2-4a47-a2c5-c3e8dedeacea tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356" status: 200 len: 1730 microversion: 2.20 time: 0.286500 Jul 05 13:07:14.090887 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 403/809] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:07:13 2022] GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356 => generated 1730 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 13:07:15.039729 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-8a36c369-0875-46ec-b6b8-756b075939c8 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:15.040335 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-8a36c369-0875-46ec-b6b8-756b075939c8 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:15.047404 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-8a36c369-0875-46ec-b6b8-756b075939c8 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:15.047964 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-8a36c369-0875-46ec-b6b8-756b075939c8 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:15.049139 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-8a36c369-0875-46ec-b6b8-756b075939c8 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:15.049871 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-8a36c369-0875-46ec-b6b8-756b075939c8 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:15.111658 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-915778ce-f8c2-427b-8b39-92d318accca5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:15.112897 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-915778ce-f8c2-427b-8b39-92d318accca5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:15.120310 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-915778ce-f8c2-427b-8b39-92d318accca5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:15.122240 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-915778ce-f8c2-427b-8b39-92d318accca5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:15.122240 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-915778ce-f8c2-427b-8b39-92d318accca5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:15.122240 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-915778ce-f8c2-427b-8b39-92d318accca5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:15.238178 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-8a36c369-0875-46ec-b6b8-756b075939c8 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:15.249149 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-8a36c369-0875-46ec-b6b8-756b075939c8 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25" status: 200 len: 1361 microversion: 2.1 time: 0.211688 Jul 05 13:07:15.249743 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 407/810] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:07:15 2022] GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 => generated 1361 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:07:15.313614 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-915778ce-f8c2-427b-8b39-92d318accca5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:15.321686 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-915778ce-f8c2-427b-8b39-92d318accca5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:15.323187 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-915778ce-f8c2-427b-8b39-92d318accca5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:15.324409 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-915778ce-f8c2-427b-8b39-92d318accca5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356" status: 200 len: 1730 microversion: 2.20 time: 0.216716 Jul 05 13:07:15.324994 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 404/811] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:07:15 2022] GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356 => generated 1730 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 13:07:15.721557 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-e29f3d87-e32b-40e9-a299-2dec028d6dc6 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dc400744-0864-4f45-80ca-82d0fa181ad3"}} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:07:15.722667 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-e29f3d87-e32b-40e9-a299-2dec028d6dc6 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 4c6520f9-4cce-44f6-a004-5226841dd52a] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:15.724549 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_cell0:SELECT=2 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:07:15.729480 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e29f3d87-e32b-40e9-a299-2dec028d6dc6 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:15.730180 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e29f3d87-e32b-40e9-a299-2dec028d6dc6 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:15.731015 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e29f3d87-e32b-40e9-a299-2dec028d6dc6 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:15.731438 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e29f3d87-e32b-40e9-a299-2dec028d6dc6 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:16.264791 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-16f163dc-d969-4edb-a185-1ff6f10f7338 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:16.266502 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-16f163dc-d969-4edb-a185-1ff6f10f7338 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:16.275884 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-16f163dc-d969-4edb-a185-1ff6f10f7338 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:16.276608 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-16f163dc-d969-4edb-a185-1ff6f10f7338 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:16.277567 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-16f163dc-d969-4edb-a185-1ff6f10f7338 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:16.278151 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-16f163dc-d969-4edb-a185-1ff6f10f7338 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:16.422531 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-16f163dc-d969-4edb-a185-1ff6f10f7338 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:16.430450 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-16f163dc-d969-4edb-a185-1ff6f10f7338 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25" status: 200 len: 1361 microversion: 2.1 time: 0.169739 Jul 05 13:07:16.431025 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 405/812] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:07:16 2022] GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 => generated 1361 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:07:16.435476 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-a36921c0-9662-41dc-8e63-696ddb5407b5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:16.436078 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-a36921c0-9662-41dc-8e63-696ddb5407b5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:16.442533 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a36921c0-9662-41dc-8e63-696ddb5407b5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:16.443610 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a36921c0-9662-41dc-8e63-696ddb5407b5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:16.445052 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a36921c0-9662-41dc-8e63-696ddb5407b5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:16.445520 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a36921c0-9662-41dc-8e63-696ddb5407b5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:16.588094 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-a36921c0-9662-41dc-8e63-696ddb5407b5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:16.596728 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-a36921c0-9662-41dc-8e63-696ddb5407b5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:16.598229 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-a36921c0-9662-41dc-8e63-696ddb5407b5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:16.599453 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-a36921c0-9662-41dc-8e63-696ddb5407b5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356" status: 200 len: 1730 microversion: 2.20 time: 0.167477 Jul 05 13:07:16.600018 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 406/813] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:07:16 2022] GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:07:16.787371 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_cell0:SELECT=14 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:07:17.448157 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-6d6c926e-363a-42f1-bd77-338c16f20fbd tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:17.448914 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-6d6c926e-363a-42f1-bd77-338c16f20fbd tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:17.456561 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6d6c926e-363a-42f1-bd77-338c16f20fbd tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:17.457098 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6d6c926e-363a-42f1-bd77-338c16f20fbd tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:17.457884 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6d6c926e-363a-42f1-bd77-338c16f20fbd tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:17.458351 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6d6c926e-363a-42f1-bd77-338c16f20fbd tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:17.631696 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-6d6c926e-363a-42f1-bd77-338c16f20fbd tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:17.639527 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-6d6c926e-363a-42f1-bd77-338c16f20fbd tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25" status: 200 len: 1361 microversion: 2.1 time: 0.195853 Jul 05 13:07:17.640100 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 407/814] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:07:17 2022] GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 => generated 1361 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:07:17.647352 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-e8039621-3082-4c2b-b1f9-a8dd34c168eb tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:17.648523 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-e8039621-3082-4c2b-b1f9-a8dd34c168eb tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:17.656433 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e8039621-3082-4c2b-b1f9-a8dd34c168eb tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:17.657059 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e8039621-3082-4c2b-b1f9-a8dd34c168eb tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:17.657957 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e8039621-3082-4c2b-b1f9-a8dd34c168eb tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:17.658490 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e8039621-3082-4c2b-b1f9-a8dd34c168eb tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:17.976468 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-e8039621-3082-4c2b-b1f9-a8dd34c168eb tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:17.985484 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-e8039621-3082-4c2b-b1f9-a8dd34c168eb tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:17.986980 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-e8039621-3082-4c2b-b1f9-a8dd34c168eb tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:17.988160 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-e8039621-3082-4c2b-b1f9-a8dd34c168eb tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356" status: 200 len: 1730 microversion: 2.20 time: 0.346978 Jul 05 13:07:17.988774 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 408/815] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:07:17 2022] GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356 => generated 1730 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:07:18.658673 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-c8927a2e-0d87-4acc-8469-5f9fc63fe6e8 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:18.659421 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-c8927a2e-0d87-4acc-8469-5f9fc63fe6e8 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:18.666204 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c8927a2e-0d87-4acc-8469-5f9fc63fe6e8 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:18.666661 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c8927a2e-0d87-4acc-8469-5f9fc63fe6e8 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:18.667487 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c8927a2e-0d87-4acc-8469-5f9fc63fe6e8 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:18.667919 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c8927a2e-0d87-4acc-8469-5f9fc63fe6e8 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:18.812400 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-c8927a2e-0d87-4acc-8469-5f9fc63fe6e8 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:18.820461 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-c8927a2e-0d87-4acc-8469-5f9fc63fe6e8 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25" status: 200 len: 1361 microversion: 2.1 time: 0.165578 Jul 05 13:07:18.821266 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 409/816] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:07:18 2022] GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 => generated 1361 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:07:19.008130 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-09fceed4-b9a8-448d-aab2-b38a6de496c4 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:19.008672 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-09fceed4-b9a8-448d-aab2-b38a6de496c4 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:19.016020 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-09fceed4-b9a8-448d-aab2-b38a6de496c4 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:19.016689 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-09fceed4-b9a8-448d-aab2-b38a6de496c4 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:19.017543 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-09fceed4-b9a8-448d-aab2-b38a6de496c4 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:19.017988 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-09fceed4-b9a8-448d-aab2-b38a6de496c4 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:19.179300 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-09fceed4-b9a8-448d-aab2-b38a6de496c4 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:19.187715 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-09fceed4-b9a8-448d-aab2-b38a6de496c4 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:19.189433 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-09fceed4-b9a8-448d-aab2-b38a6de496c4 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:19.190605 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-09fceed4-b9a8-448d-aab2-b38a6de496c4 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356" status: 200 len: 1730 microversion: 2.20 time: 0.187121 Jul 05 13:07:19.191248 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 410/817] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:07:19 2022] GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356 => generated 1730 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 13:07:19.838346 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-40550a3d-15e8-4854-b145-f780b2e752ff tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:19.857741 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-40550a3d-15e8-4854-b145-f780b2e752ff tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:19.857741 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-40550a3d-15e8-4854-b145-f780b2e752ff tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:19.857741 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-40550a3d-15e8-4854-b145-f780b2e752ff tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:19.857741 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-40550a3d-15e8-4854-b145-f780b2e752ff tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:19.858168 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-40550a3d-15e8-4854-b145-f780b2e752ff tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:19.989187 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-40550a3d-15e8-4854-b145-f780b2e752ff tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:20.001529 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-40550a3d-15e8-4854-b145-f780b2e752ff tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25" status: 200 len: 1361 microversion: 2.1 time: 0.166625 Jul 05 13:07:20.007676 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 411/818] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:07:19 2022] GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 => generated 1361 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:07:20.209023 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-1a205126-137d-4cc0-bdc1-fb66038c855f tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:20.209544 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-1a205126-137d-4cc0-bdc1-fb66038c855f tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:20.215648 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1a205126-137d-4cc0-bdc1-fb66038c855f tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:20.216106 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1a205126-137d-4cc0-bdc1-fb66038c855f tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:20.216903 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1a205126-137d-4cc0-bdc1-fb66038c855f tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:20.217345 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1a205126-137d-4cc0-bdc1-fb66038c855f tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:20.348768 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-1a205126-137d-4cc0-bdc1-fb66038c855f tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:20.357386 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-1a205126-137d-4cc0-bdc1-fb66038c855f tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:20.358907 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-1a205126-137d-4cc0-bdc1-fb66038c855f tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:20.360065 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-1a205126-137d-4cc0-bdc1-fb66038c855f tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356" status: 200 len: 1730 microversion: 2.20 time: 0.155137 Jul 05 13:07:20.360646 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 412/819] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:07:20 2022] GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 13:07:21.020195 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-937e5f30-6b7f-4c30-bc81-278498a80f79 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:21.020845 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-937e5f30-6b7f-4c30-bc81-278498a80f79 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:21.027854 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-937e5f30-6b7f-4c30-bc81-278498a80f79 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:21.028299 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-937e5f30-6b7f-4c30-bc81-278498a80f79 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:21.029091 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-937e5f30-6b7f-4c30-bc81-278498a80f79 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:21.029525 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-937e5f30-6b7f-4c30-bc81-278498a80f79 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:21.156484 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-937e5f30-6b7f-4c30-bc81-278498a80f79 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:21.158796 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell1:SELECT=100 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:07:21.164861 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-937e5f30-6b7f-4c30-bc81-278498a80f79 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25" status: 200 len: 1361 microversion: 2.1 time: 0.148376 Jul 05 13:07:21.165419 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 413/820] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:07:21 2022] GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 => generated 1361 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:07:21.379514 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-d494d38d-cf67-4c09-bd42-fd286e9ba12c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:21.380125 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-d494d38d-cf67-4c09-bd42-fd286e9ba12c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:21.386810 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d494d38d-cf67-4c09-bd42-fd286e9ba12c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:21.387259 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d494d38d-cf67-4c09-bd42-fd286e9ba12c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:21.388046 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d494d38d-cf67-4c09-bd42-fd286e9ba12c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:21.388484 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d494d38d-cf67-4c09-bd42-fd286e9ba12c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:21.516448 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-d494d38d-cf67-4c09-bd42-fd286e9ba12c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:21.524287 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-d494d38d-cf67-4c09-bd42-fd286e9ba12c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:21.525819 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-d494d38d-cf67-4c09-bd42-fd286e9ba12c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:21.526969 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-d494d38d-cf67-4c09-bd42-fd286e9ba12c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356" status: 200 len: 1730 microversion: 2.20 time: 0.151675 Jul 05 13:07:21.527518 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 414/821] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:07:21 2022] GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 13:07:22.182225 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-8da5510b-2f2e-467a-8e62-bec22957f6ca tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:22.182902 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-8da5510b-2f2e-467a-8e62-bec22957f6ca tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:22.187236 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-e29f3d87-e32b-40e9-a299-2dec028d6dc6 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "POST /compute/v2.1/servers/4c6520f9-4cce-44f6-a004-5226841dd52a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.469496 Jul 05 13:07:22.187830 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 408/822] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Jul 5 13:07:15 2022] POST /compute/v2.1/servers/4c6520f9-4cce-44f6-a004-5226841dd52a/os-volume_attachments => generated 194 bytes in 6471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:07:22.189371 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8da5510b-2f2e-467a-8e62-bec22957f6ca tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:22.189824 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8da5510b-2f2e-467a-8e62-bec22957f6ca tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:22.190621 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8da5510b-2f2e-467a-8e62-bec22957f6ca tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:22.191055 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8da5510b-2f2e-467a-8e62-bec22957f6ca tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:22.322070 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-8da5510b-2f2e-467a-8e62-bec22957f6ca tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:22.329355 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-8da5510b-2f2e-467a-8e62-bec22957f6ca tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25" status: 200 len: 1361 microversion: 2.1 time: 0.151058 Jul 05 13:07:22.329939 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 415/823] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:07:22 2022] GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:07:22.545331 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-b8e8c045-1db7-4e5c-bd22-43de8d0dde28 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:22.546027 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-b8e8c045-1db7-4e5c-bd22-43de8d0dde28 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:22.553056 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b8e8c045-1db7-4e5c-bd22-43de8d0dde28 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:22.553499 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b8e8c045-1db7-4e5c-bd22-43de8d0dde28 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:22.554480 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b8e8c045-1db7-4e5c-bd22-43de8d0dde28 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:22.554914 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b8e8c045-1db7-4e5c-bd22-43de8d0dde28 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:22.569057 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:07:22.688103 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-b8e8c045-1db7-4e5c-bd22-43de8d0dde28 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:22.696770 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-b8e8c045-1db7-4e5c-bd22-43de8d0dde28 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:22.698305 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-b8e8c045-1db7-4e5c-bd22-43de8d0dde28 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:22.699444 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-b8e8c045-1db7-4e5c-bd22-43de8d0dde28 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356" status: 200 len: 1730 microversion: 2.20 time: 0.158377 Jul 05 13:07:22.699985 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 409/824] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:07:22 2022] GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:07:22.854823 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-5256cbf4-46a4-401f-b3fe-bda29e3a23bc tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:22.855529 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-5256cbf4-46a4-401f-b3fe-bda29e3a23bc tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: ba68561c-87aa-4ad8-a50c-de2cd1e938e2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:22.861525 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5256cbf4-46a4-401f-b3fe-bda29e3a23bc tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:22.861967 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5256cbf4-46a4-401f-b3fe-bda29e3a23bc tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:22.862717 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5256cbf4-46a4-401f-b3fe-bda29e3a23bc tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:22.863150 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5256cbf4-46a4-401f-b3fe-bda29e3a23bc tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:22.887781 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-5256cbf4-46a4-401f-b3fe-bda29e3a23bc tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: ba68561c-87aa-4ad8-a50c-de2cd1e938e2] Going to try to terminate instance {{(pid=118387) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 13:07:23.292144 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-5256cbf4-46a4-401f-b3fe-bda29e3a23bc tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ba68561c-87aa-4ad8-a50c-de2cd1e938e2" status: 204 len: 0 microversion: 2.1 time: 0.441030 Jul 05 13:07:23.293813 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 416/825] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jul 5 13:07:22 2022] DELETE /compute/v2.1/servers/ba68561c-87aa-4ad8-a50c-de2cd1e938e2 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 05 13:07:23.301371 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-6e7f9165-77c2-4aec-afd7-b3df41c8ae57 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:23.302021 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-6e7f9165-77c2-4aec-afd7-b3df41c8ae57 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: ba68561c-87aa-4ad8-a50c-de2cd1e938e2] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:23.308710 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-6e7f9165-77c2-4aec-afd7-b3df41c8ae57 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:23.309158 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-6e7f9165-77c2-4aec-afd7-b3df41c8ae57 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:23.309907 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-6e7f9165-77c2-4aec-afd7-b3df41c8ae57 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:23.310338 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-6e7f9165-77c2-4aec-afd7-b3df41c8ae57 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:23.347000 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-c5d9713d-eb5a-4b95-b2cd-63d1deccbfaa tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:23.347694 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-c5d9713d-eb5a-4b95-b2cd-63d1deccbfaa tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:23.354439 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c5d9713d-eb5a-4b95-b2cd-63d1deccbfaa tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:23.356940 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c5d9713d-eb5a-4b95-b2cd-63d1deccbfaa tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:23.356940 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c5d9713d-eb5a-4b95-b2cd-63d1deccbfaa tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:23.356940 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c5d9713d-eb5a-4b95-b2cd-63d1deccbfaa tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:23.497535 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-6e7f9165-77c2-4aec-afd7-b3df41c8ae57 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661062780f5c45d180a05e402fc7bc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277fa3c89dff47b88894b781ff69fb70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:23.505024 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-6e7f9165-77c2-4aec-afd7-b3df41c8ae57 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/ba68561c-87aa-4ad8-a50c-de2cd1e938e2" status: 200 len: 1578 microversion: 2.1 time: 0.207655 Jul 05 13:07:23.505610 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 410/826] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:07:23 2022] GET /compute/v2.1/servers/ba68561c-87aa-4ad8-a50c-de2cd1e938e2 => generated 1578 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:07:23.525124 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-c5d9713d-eb5a-4b95-b2cd-63d1deccbfaa tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:23.532617 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-c5d9713d-eb5a-4b95-b2cd-63d1deccbfaa tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25" status: 200 len: 1361 microversion: 2.1 time: 0.189721 Jul 05 13:07:23.533160 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 417/827] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:07:23 2022] GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 => generated 1361 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:07:23.717965 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-67406723-2b26-472f-8e18-df79ed6645e9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:23.718572 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-67406723-2b26-472f-8e18-df79ed6645e9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:23.725147 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-67406723-2b26-472f-8e18-df79ed6645e9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:23.725587 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-67406723-2b26-472f-8e18-df79ed6645e9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:23.726343 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-67406723-2b26-472f-8e18-df79ed6645e9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:23.727338 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-67406723-2b26-472f-8e18-df79ed6645e9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:23.864934 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-67406723-2b26-472f-8e18-df79ed6645e9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:23.872916 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-67406723-2b26-472f-8e18-df79ed6645e9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:23.877797 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-67406723-2b26-472f-8e18-df79ed6645e9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:23.877797 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-67406723-2b26-472f-8e18-df79ed6645e9 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356" status: 200 len: 1730 microversion: 2.20 time: 0.161517 Jul 05 13:07:23.877797 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 411/828] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:07:23 2022] GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:07:24.522276 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-aae0f837-abbb-456f-b0d5-4c7be6e85ab8 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:24.522888 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-aae0f837-abbb-456f-b0d5-4c7be6e85ab8 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: ba68561c-87aa-4ad8-a50c-de2cd1e938e2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:24.529418 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-aae0f837-abbb-456f-b0d5-4c7be6e85ab8 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:24.529869 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-aae0f837-abbb-456f-b0d5-4c7be6e85ab8 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:24.530624 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-aae0f837-abbb-456f-b0d5-4c7be6e85ab8 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:24.531054 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-aae0f837-abbb-456f-b0d5-4c7be6e85ab8 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:24.549974 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-2495dc1d-ad10-4d99-a640-e1dd9734bf00 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:24.550752 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-2495dc1d-ad10-4d99-a640-e1dd9734bf00 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:24.557272 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-2495dc1d-ad10-4d99-a640-e1dd9734bf00 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:24.557717 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-2495dc1d-ad10-4d99-a640-e1dd9734bf00 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:24.558476 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-2495dc1d-ad10-4d99-a640-e1dd9734bf00 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:24.558907 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-2495dc1d-ad10-4d99-a640-e1dd9734bf00 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:24.715419 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-aae0f837-abbb-456f-b0d5-4c7be6e85ab8 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661062780f5c45d180a05e402fc7bc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277fa3c89dff47b88894b781ff69fb70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:24.723129 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-aae0f837-abbb-456f-b0d5-4c7be6e85ab8 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/ba68561c-87aa-4ad8-a50c-de2cd1e938e2" status: 200 len: 1578 microversion: 2.1 time: 0.204605 Jul 05 13:07:24.723686 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 418/829] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:07:24 2022] GET /compute/v2.1/servers/ba68561c-87aa-4ad8-a50c-de2cd1e938e2 => generated 1578 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:07:24.738440 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-2495dc1d-ad10-4d99-a640-e1dd9734bf00 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:24.746491 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-2495dc1d-ad10-4d99-a640-e1dd9734bf00 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25" status: 200 len: 1361 microversion: 2.1 time: 0.200445 Jul 05 13:07:24.747053 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 412/830] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:07:24 2022] GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 => generated 1361 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:07:24.894114 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-7cb73c96-5f12-46ac-87a8-69b8ced2d6ff tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:24.894646 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-7cb73c96-5f12-46ac-87a8-69b8ced2d6ff tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:24.901289 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7cb73c96-5f12-46ac-87a8-69b8ced2d6ff tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:24.901739 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7cb73c96-5f12-46ac-87a8-69b8ced2d6ff tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:24.902507 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7cb73c96-5f12-46ac-87a8-69b8ced2d6ff tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:24.902944 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7cb73c96-5f12-46ac-87a8-69b8ced2d6ff tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:25.035746 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-7cb73c96-5f12-46ac-87a8-69b8ced2d6ff tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:25.044463 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-7cb73c96-5f12-46ac-87a8-69b8ced2d6ff tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:25.046112 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-7cb73c96-5f12-46ac-87a8-69b8ced2d6ff tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:25.047288 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-7cb73c96-5f12-46ac-87a8-69b8ced2d6ff tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356" status: 200 len: 1730 microversion: 2.20 time: 0.157263 Jul 05 13:07:25.048051 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 419/831] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:07:24 2022] GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 13:07:25.741326 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-3344ee21-3685-4a9d-b6f3-595f87c991d0 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:25.742124 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-3344ee21-3685-4a9d-b6f3-595f87c991d0 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: ba68561c-87aa-4ad8-a50c-de2cd1e938e2] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:25.750224 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-3344ee21-3685-4a9d-b6f3-595f87c991d0 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:25.751062 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-3344ee21-3685-4a9d-b6f3-595f87c991d0 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:25.751966 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-3344ee21-3685-4a9d-b6f3-595f87c991d0 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:25.752646 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-3344ee21-3685-4a9d-b6f3-595f87c991d0 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:25.767028 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-3a93ca09-7cc7-4bdd-8b75-f03d1cfe7084 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:25.772407 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-3a93ca09-7cc7-4bdd-8b75-f03d1cfe7084 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:25.783563 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3a93ca09-7cc7-4bdd-8b75-f03d1cfe7084 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:25.784016 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3a93ca09-7cc7-4bdd-8b75-f03d1cfe7084 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:25.785774 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3a93ca09-7cc7-4bdd-8b75-f03d1cfe7084 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:25.786685 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3a93ca09-7cc7-4bdd-8b75-f03d1cfe7084 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:25.842762 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-3344ee21-3685-4a9d-b6f3-595f87c991d0 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661062780f5c45d180a05e402fc7bc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277fa3c89dff47b88894b781ff69fb70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:25.852470 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-3344ee21-3685-4a9d-b6f3-595f87c991d0 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/ba68561c-87aa-4ad8-a50c-de2cd1e938e2" status: 200 len: 1511 microversion: 2.1 time: 0.115097 Jul 05 13:07:25.853809 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 413/832] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:07:25 2022] GET /compute/v2.1/servers/ba68561c-87aa-4ad8-a50c-de2cd1e938e2 => generated 1511 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:07:25.950153 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-3a93ca09-7cc7-4bdd-8b75-f03d1cfe7084 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:25.961580 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-3a93ca09-7cc7-4bdd-8b75-f03d1cfe7084 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25" status: 200 len: 1361 microversion: 2.1 time: 0.200243 Jul 05 13:07:25.962930 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 420/833] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:07:25 2022] GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 => generated 1361 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:07:26.036982 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [req-5f9f1fbe-1ab4-44f4-a562-0a2aa51dac63 req-f1b35c1a-3d42-43f0-8c49-299565bb853b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42411ae1-103e-4934-9594-aaf06cc8a356", "name": "network-vif-plugged", "status": "completed", "tag": "0eb7994b-94fe-4d89-a3c9-6b498bab0720"}]} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:07:26.057200 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-5f9f1fbe-1ab4-44f4-a562-0a2aa51dac63 req-f1b35c1a-3d42-43f0-8c49-299565bb853b service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:26.064834 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-5f9f1fbe-1ab4-44f4-a562-0a2aa51dac63 req-f1b35c1a-3d42-43f0-8c49-299565bb853b service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:26.067104 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-742009e4-7bde-46a5-b6d5-ed82499c9979 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:26.068818 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-742009e4-7bde-46a5-b6d5-ed82499c9979 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:26.075556 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-742009e4-7bde-46a5-b6d5-ed82499c9979 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:26.076039 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-742009e4-7bde-46a5-b6d5-ed82499c9979 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:26.076856 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-742009e4-7bde-46a5-b6d5-ed82499c9979 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:26.077303 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-742009e4-7bde-46a5-b6d5-ed82499c9979 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:26.082621 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.compute.server_external_events [req-5f9f1fbe-1ab4-44f4-a562-0a2aa51dac63 req-f1b35c1a-3d42-43f0-8c49-299565bb853b service nova] Creating event network-vif-plugged:0eb7994b-94fe-4d89-a3c9-6b498bab0720 for instance 42411ae1-103e-4934-9594-aaf06cc8a356 on hv-cinder-79760 Jul 05 13:07:26.096172 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [req-5f9f1fbe-1ab4-44f4-a562-0a2aa51dac63 req-f1b35c1a-3d42-43f0-8c49-299565bb853b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057406 Jul 05 13:07:26.096172 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 414/834] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:07:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:07:26.216093 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [req-a743fd27-133b-4dc5-a1e7-e36fa6dff609 req-b27c3e58-5ef7-4312-ba87-8e55b6ca7512 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba68561c-87aa-4ad8-a50c-de2cd1e938e2", "name": "network-vif-deleted", "tag": "6ed74edc-a183-4968-acd8-ac4783a16025"}]} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:07:26.220175 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-a743fd27-133b-4dc5-a1e7-e36fa6dff609 req-b27c3e58-5ef7-4312-ba87-8e55b6ca7512 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:26.220729 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-a743fd27-133b-4dc5-a1e7-e36fa6dff609 req-b27c3e58-5ef7-4312-ba87-8e55b6ca7512 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:26.233897 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.compute.server_external_events [req-a743fd27-133b-4dc5-a1e7-e36fa6dff609 req-b27c3e58-5ef7-4312-ba87-8e55b6ca7512 service nova] Creating event network-vif-deleted:6ed74edc-a183-4968-acd8-ac4783a16025 for instance ba68561c-87aa-4ad8-a50c-de2cd1e938e2 on hv-cinder-79760 Jul 05 13:07:26.238606 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [req-a743fd27-133b-4dc5-a1e7-e36fa6dff609 req-b27c3e58-5ef7-4312-ba87-8e55b6ca7512 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032283 Jul 05 13:07:26.239312 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 415/835] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:07:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 13:07:26.276005 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-742009e4-7bde-46a5-b6d5-ed82499c9979 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:26.284530 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-742009e4-7bde-46a5-b6d5-ed82499c9979 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:26.286064 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-742009e4-7bde-46a5-b6d5-ed82499c9979 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:26.287224 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-742009e4-7bde-46a5-b6d5-ed82499c9979 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356" status: 200 len: 1730 microversion: 2.20 time: 0.224822 Jul 05 13:07:26.287774 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 421/836] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:07:26 2022] GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356 => generated 1730 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 13:07:26.872928 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-58d494f2-6a25-4c99-bae6-b0ffad160140 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:26.873718 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-58d494f2-6a25-4c99-bae6-b0ffad160140 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: ba68561c-87aa-4ad8-a50c-de2cd1e938e2] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:26.880181 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-58d494f2-6a25-4c99-bae6-b0ffad160140 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:26.880653 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-58d494f2-6a25-4c99-bae6-b0ffad160140 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:26.881435 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-58d494f2-6a25-4c99-bae6-b0ffad160140 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:26.881877 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-58d494f2-6a25-4c99-bae6-b0ffad160140 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:26.954562 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-58d494f2-6a25-4c99-bae6-b0ffad160140 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661062780f5c45d180a05e402fc7bc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277fa3c89dff47b88894b781ff69fb70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:26.962343 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-58d494f2-6a25-4c99-bae6-b0ffad160140 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/ba68561c-87aa-4ad8-a50c-de2cd1e938e2" status: 200 len: 1226 microversion: 2.1 time: 0.094793 Jul 05 13:07:26.962912 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 416/837] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:07:26 2022] GET /compute/v2.1/servers/ba68561c-87aa-4ad8-a50c-de2cd1e938e2 => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:07:26.978119 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-d371aed9-5327-4695-a7cf-a6475325339c tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:26.978746 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-d371aed9-5327-4695-a7cf-a6475325339c tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:26.985631 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d371aed9-5327-4695-a7cf-a6475325339c tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:26.986105 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d371aed9-5327-4695-a7cf-a6475325339c tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:26.986854 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d371aed9-5327-4695-a7cf-a6475325339c tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:26.987310 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d371aed9-5327-4695-a7cf-a6475325339c tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:27.123157 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-d371aed9-5327-4695-a7cf-a6475325339c tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:27.130761 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-d371aed9-5327-4695-a7cf-a6475325339c tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25" status: 200 len: 1361 microversion: 2.1 time: 0.156956 Jul 05 13:07:27.131323 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 422/838] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:07:26 2022] GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:07:27.305958 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-3cab03ce-7703-477f-a151-e3f84965cff3 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:27.306585 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-3cab03ce-7703-477f-a151-e3f84965cff3 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:27.313574 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-3cab03ce-7703-477f-a151-e3f84965cff3 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:27.318402 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-3cab03ce-7703-477f-a151-e3f84965cff3 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:27.318402 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-3cab03ce-7703-477f-a151-e3f84965cff3 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:27.318402 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-3cab03ce-7703-477f-a151-e3f84965cff3 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:27.447610 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-3cab03ce-7703-477f-a151-e3f84965cff3 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:27.455861 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-3cab03ce-7703-477f-a151-e3f84965cff3 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:27.457295 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-3cab03ce-7703-477f-a151-e3f84965cff3 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:27.458460 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-3cab03ce-7703-477f-a151-e3f84965cff3 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356" status: 200 len: 1730 microversion: 2.20 time: 0.156396 Jul 05 13:07:27.459013 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 417/839] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:07:27 2022] GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:07:27.979130 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-2436d0c7-70ae-4a47-a321-b9c9dbfc7022 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:27.979647 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-2436d0c7-70ae-4a47-a321-b9c9dbfc7022 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: ba68561c-87aa-4ad8-a50c-de2cd1e938e2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:27.986528 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2436d0c7-70ae-4a47-a321-b9c9dbfc7022 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:27.986896 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2436d0c7-70ae-4a47-a321-b9c9dbfc7022 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:27.987673 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2436d0c7-70ae-4a47-a321-b9c9dbfc7022 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:27.988111 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2436d0c7-70ae-4a47-a321-b9c9dbfc7022 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:28.019789 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2436d0c7-70ae-4a47-a321-b9c9dbfc7022 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:28.020238 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2436d0c7-70ae-4a47-a321-b9c9dbfc7022 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:28.020713 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.objects.instance [None req-2436d0c7-70ae-4a47-a321-b9c9dbfc7022 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lazy-loading 'fault' on Instance uuid ba68561c-87aa-4ad8-a50c-de2cd1e938e2 {{(pid=118387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 13:07:28.063011 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-2436d0c7-70ae-4a47-a321-b9c9dbfc7022 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661062780f5c45d180a05e402fc7bc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277fa3c89dff47b88894b781ff69fb70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:28.071457 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-2436d0c7-70ae-4a47-a321-b9c9dbfc7022 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/ba68561c-87aa-4ad8-a50c-de2cd1e938e2" status: 200 len: 1231 microversion: 2.1 time: 0.096339 Jul 05 13:07:28.072043 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 423/840] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:07:27 2022] GET /compute/v2.1/servers/ba68561c-87aa-4ad8-a50c-de2cd1e938e2 => generated 1231 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:07:28.104393 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [req-110944c2-e42a-41f8-b4f9-be498106a931 req-7d6c95c9-e4f5-4fec-8dc2-e5b2e61c053b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b55ca313-2e09-4b58-b7e7-cdda74ffdd25", "name": "network-vif-plugged", "status": "completed", "tag": "10c331f6-aa21-4291-bc1b-87fa3f5495ba"}]} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:07:28.113451 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-110944c2-e42a-41f8-b4f9-be498106a931 req-7d6c95c9-e4f5-4fec-8dc2-e5b2e61c053b service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:28.113896 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-110944c2-e42a-41f8-b4f9-be498106a931 req-7d6c95c9-e4f5-4fec-8dc2-e5b2e61c053b service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:28.126763 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.compute.server_external_events [req-110944c2-e42a-41f8-b4f9-be498106a931 req-7d6c95c9-e4f5-4fec-8dc2-e5b2e61c053b service nova] Creating event network-vif-plugged:10c331f6-aa21-4291-bc1b-87fa3f5495ba for instance b55ca313-2e09-4b58-b7e7-cdda74ffdd25 on hv-cinder-79760 Jul 05 13:07:28.131460 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [req-110944c2-e42a-41f8-b4f9-be498106a931 req-7d6c95c9-e4f5-4fec-8dc2-e5b2e61c053b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030796 Jul 05 13:07:28.132049 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 418/841] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:07:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:07:28.147334 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-967b9d1a-ddbc-4032-945d-5d6a5e7daff2 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:28.150601 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-967b9d1a-ddbc-4032-945d-5d6a5e7daff2 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:28.154550 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-967b9d1a-ddbc-4032-945d-5d6a5e7daff2 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:28.155004 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-967b9d1a-ddbc-4032-945d-5d6a5e7daff2 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:28.155841 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-967b9d1a-ddbc-4032-945d-5d6a5e7daff2 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:28.156276 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-967b9d1a-ddbc-4032-945d-5d6a5e7daff2 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:28.293373 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-967b9d1a-ddbc-4032-945d-5d6a5e7daff2 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:28.300828 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-967b9d1a-ddbc-4032-945d-5d6a5e7daff2 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25" status: 200 len: 1361 microversion: 2.1 time: 0.157518 Jul 05 13:07:28.301553 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 424/842] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:07:28 2022] GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:07:28.478208 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-a3c6d137-e9c5-476b-9949-ae406545c4e4 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:28.479068 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-a3c6d137-e9c5-476b-9949-ae406545c4e4 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:28.485984 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a3c6d137-e9c5-476b-9949-ae406545c4e4 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:28.486576 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a3c6d137-e9c5-476b-9949-ae406545c4e4 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:28.487431 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a3c6d137-e9c5-476b-9949-ae406545c4e4 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:28.487879 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a3c6d137-e9c5-476b-9949-ae406545c4e4 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:28.626777 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-a3c6d137-e9c5-476b-9949-ae406545c4e4 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:28.634641 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-a3c6d137-e9c5-476b-9949-ae406545c4e4 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:28.636276 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-a3c6d137-e9c5-476b-9949-ae406545c4e4 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:28.637475 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-a3c6d137-e9c5-476b-9949-ae406545c4e4 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356" status: 200 len: 1730 microversion: 2.20 time: 0.164231 Jul 05 13:07:28.638029 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 419/843] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:07:28 2022] GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:07:29.088666 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-6ca74411-d8c6-49de-9d5a-9df9d2f3c149 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:29.089326 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-6ca74411-d8c6-49de-9d5a-9df9d2f3c149 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: ba68561c-87aa-4ad8-a50c-de2cd1e938e2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:29.095256 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6ca74411-d8c6-49de-9d5a-9df9d2f3c149 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:29.095702 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6ca74411-d8c6-49de-9d5a-9df9d2f3c149 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:29.096463 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6ca74411-d8c6-49de-9d5a-9df9d2f3c149 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:29.096920 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6ca74411-d8c6-49de-9d5a-9df9d2f3c149 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:29.110639 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.wsgi [None req-6ca74411-d8c6-49de-9d5a-9df9d2f3c149 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] HTTP exception thrown: Instance ba68561c-87aa-4ad8-a50c-de2cd1e938e2 could not be found. Jul 05 13:07:29.112376 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-6ca74411-d8c6-49de-9d5a-9df9d2f3c149 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Request method failure captured: Jul 05 13:07:29.112376 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: request: GET /compute/v2.1/servers/ba68561c-87aa-4ad8-a50c-de2cd1e938e2 HTTP/1.1 Jul 05 13:07:29.112376 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept: application/json Jul 05 13:07:29.112376 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept-Encoding: identity Jul 05 13:07:29.112376 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Connection: close Jul 05 13:07:29.112376 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Length: 0 Jul 05 13:07:29.112376 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Type: application/json Jul 05 13:07:29.112376 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Host: 10.222.0.36 Jul 05 13:07:29.112376 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Openstack-System-Scope: None Jul 05 13:07:29.112376 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: User-Agent: python-urllib3/1.26.9 Jul 05 13:07:29.112376 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Auth-Token: gAAAAABixDbHzxrNn2lrBPEZh092wnZ2gE7LtmxuF4JSZVsPZKEavBss92px7GMxGXF0VBkurmr11L6TG6RF8h6Duo7dMSMY0qzV8b_J9Orq0Ml5zDOld7rA4VneT6r7i1irMLipQGpBEy1MEss_XpDOHSnalPxalqpcArH4LoQ5ISJh4SfaUOM Jul 05 13:07:29.112376 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Id: None Jul 05 13:07:29.112376 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Name: None Jul 05 13:07:29.112376 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Identity-Status: Confirmed Jul 05 13:07:29.112376 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Is-Admin-Project: True Jul 05 13:07:29.112376 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Id: default Jul 05 13:07:29.112376 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Name: Default Jul 05 13:07:29.112376 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Id: 277fa3c89dff47b88894b781ff69fb70 Jul 05 13:07:29.112376 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Name: tempest-TestVolumeBootPattern-848454944 Jul 05 13:07:29.112376 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Role: member,reader Jul 05 13:07:29.112376 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Roles: member,reader Jul 05 13:07:29.114289 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/277fa3c89dff47b88894b781ff69fb70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_277fa3c89dff47b88894b781ff69fb70", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/277fa3c89dff47b88894b781ff69fb70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/277fa3c89dff47b88894b781ff69fb70"}]}] Jul 05 13:07:29.114289 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant: tempest-TestVolumeBootPattern-848454944 Jul 05 13:07:29.114289 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Id: 277fa3c89dff47b88894b781ff69fb70 Jul 05 13:07:29.114289 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Name: tempest-TestVolumeBootPattern-848454944 Jul 05 13:07:29.114289 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User: tempest-TestVolumeBootPattern-848454944-project Jul 05 13:07:29.114289 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Id: default Jul 05 13:07:29.114289 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Name: Default Jul 05 13:07:29.114289 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Id: 661062780f5c45d180a05e402fc7bc27 Jul 05 13:07:29.114289 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Name: tempest-TestVolumeBootPattern-848454944-project Jul 05 13:07:29.114289 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: method: > Jul 05 13:07:29.114289 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: exception: Instance ba68561c-87aa-4ad8-a50c-de2cd1e938e2 could not be found. Jul 05 13:07:29.114289 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: action_args: {'id': 'ba68561c-87aa-4ad8-a50c-de2cd1e938e2'} Jul 05 13:07:29.115106 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 13:07:29.115106 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:07:29.115106 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 13:07:29.115106 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 13:07:29.115106 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 13:07:29.115106 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 13:07:29.115106 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 13:07:29.115106 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 13:07:29.115106 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 13:07:29.115106 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 13:07:29.115106 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba68561c-87aa-4ad8-a50c-de2cd1e938e2 could not be found. Jul 05 13:07:29.115106 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:07:29.115106 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:07:29.115106 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:07:29.115106 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:07:29.115106 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:07:29.115106 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:07:29.115106 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 13:07:29.115106 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 13:07:29.115106 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 13:07:29.116654 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 13:07:29.116654 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 13:07:29.116654 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 13:07:29.116654 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 13:07:29.116654 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 13:07:29.116654 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 13:07:29.116654 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 13:07:29.116654 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba68561c-87aa-4ad8-a50c-de2cd1e938e2 could not be found. Jul 05 13:07:29.116654 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:07:29.116654 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:07:29.116654 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:07:29.116654 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:07:29.116654 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:07:29.116654 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:07:29.116654 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 13:07:29.116654 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 13:07:29.116654 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba68561c-87aa-4ad8-a50c-de2cd1e938e2 could not be found. Jul 05 13:07:29.116654 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:07:29.118098 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-6ca74411-d8c6-49de-9d5a-9df9d2f3c149 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Returning 404 to user: Instance ba68561c-87aa-4ad8-a50c-de2cd1e938e2 could not be found. {{(pid=118387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 13:07:29.118098 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-6ca74411-d8c6-49de-9d5a-9df9d2f3c149 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/ba68561c-87aa-4ad8-a50c-de2cd1e938e2" status: 404 len: 111 microversion: 2.1 time: 0.029850 Jul 05 13:07:29.118098 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 425/844] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:07:29 2022] GET /compute/v2.1/servers/ba68561c-87aa-4ad8-a50c-de2cd1e938e2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 13:07:29.262655 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-7394d838-d5a7-40df-ae4f-55e936231773 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2129470841", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1066638790", "security_groups": [{"name": "tempest-secgroup-smoke-350473549"}], "block_device_mapping_v2": [{"uuid": "46f24030-b09b-4e9c-b525-ece80dcc0197", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6d0ec387-dad6-4122-8b47-8b2426ab2be9"}]}} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:07:29.318138 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-98d498a6-c3b0-4038-b7fc-074344ee907d tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:29.318551 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-98d498a6-c3b0-4038-b7fc-074344ee907d tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:29.325073 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-98d498a6-c3b0-4038-b7fc-074344ee907d tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:29.325522 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-98d498a6-c3b0-4038-b7fc-074344ee907d tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:29.326276 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-98d498a6-c3b0-4038-b7fc-074344ee907d tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:29.326708 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-98d498a6-c3b0-4038-b7fc-074344ee907d tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:29.401714 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.network.neutron [None req-7394d838-d5a7-40df-ae4f-55e936231773 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] validate_networks() for [('6d0ec387-dad6-4122-8b47-8b2426ab2be9', None, None, None, None, None)] {{(pid=118386) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 13:07:29.535742 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-98d498a6-c3b0-4038-b7fc-074344ee907d tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:29.543441 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-98d498a6-c3b0-4038-b7fc-074344ee907d tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25" status: 200 len: 1361 microversion: 2.1 time: 0.229298 Jul 05 13:07:29.543996 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 426/845] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:07:29 2022] GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 => generated 1361 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:07:29.655452 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-c0135188-78d7-40dd-98ca-259046dcc142 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:29.656058 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-c0135188-78d7-40dd-98ca-259046dcc142 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:29.662120 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c0135188-78d7-40dd-98ca-259046dcc142 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:29.667198 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c0135188-78d7-40dd-98ca-259046dcc142 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:29.667198 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c0135188-78d7-40dd-98ca-259046dcc142 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:29.667198 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c0135188-78d7-40dd-98ca-259046dcc142 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:29.872286 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-c0135188-78d7-40dd-98ca-259046dcc142 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:29.880365 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-c0135188-78d7-40dd-98ca-259046dcc142 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:29.883188 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-c0135188-78d7-40dd-98ca-259046dcc142 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:29.883326 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-c0135188-78d7-40dd-98ca-259046dcc142 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356" status: 200 len: 1717 microversion: 2.20 time: 0.231770 Jul 05 13:07:29.883768 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 427/846] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:07:29 2022] GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356 => generated 1717 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 13:07:29.895444 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.virt.hardware [None req-7394d838-d5a7-40df-ae4f-55e936231773 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Flavor limits 0:0:0 {{(pid=118386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 13:07:29.896280 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.virt.hardware [None req-7394d838-d5a7-40df-ae4f-55e936231773 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Image limits 0:0:0 {{(pid=118386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 13:07:29.896856 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.virt.hardware [None req-7394d838-d5a7-40df-ae4f-55e936231773 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Flavor pref 0:0:0 {{(pid=118386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 13:07:29.897263 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.virt.hardware [None req-7394d838-d5a7-40df-ae4f-55e936231773 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Image pref 0:0:0 {{(pid=118386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 13:07:29.897671 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.virt.hardware [None req-7394d838-d5a7-40df-ae4f-55e936231773 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 13:07:29.906518 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-7394d838-d5a7-40df-ae4f-55e936231773 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:29.906956 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-7394d838-d5a7-40df-ae4f-55e936231773 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:29.907922 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-7394d838-d5a7-40df-ae4f-55e936231773 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:29.908352 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-7394d838-d5a7-40df-ae4f-55e936231773 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:29.924838 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.quota [None req-7394d838-d5a7-40df-ae4f-55e936231773 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Getting quotas for project 277fa3c89dff47b88894b781ff69fb70. Resources: {'instances', 'cores', 'ram'} {{(pid=118386) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 13:07:29.928722 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.quota [None req-7394d838-d5a7-40df-ae4f-55e936231773 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Getting quotas for user 661062780f5c45d180a05e402fc7bc27 and project 277fa3c89dff47b88894b781ff69fb70. Resources: {'instances', 'cores', 'ram'} {{(pid=118386) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 13:07:29.984563 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-7394d838-d5a7-40df-ae4f-55e936231773 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Going to run 1 instances... {{(pid=118386) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 13:07:29.986644 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-7394d838-d5a7-40df-ae4f-55e936231773 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: 0bcc1600-ecfa-4cf0-929c-03cd036d07c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='46f24030-b09b-4e9c-b525-ece80dcc0197',volume_size=None,volume_type=None)] {{(pid=118386) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 13:07:30.373368 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-7394d838-d5a7-40df-ae4f-55e936231773 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.114634 Jul 05 13:07:30.374185 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 420/847] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jul 5 13:07:29 2022] POST /compute/v2.1/servers => generated 405 bytes in 1117 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 05 13:07:30.384040 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-f926d24b-38b4-4d68-a1ad-5fa81fdb0d2c tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:30.384812 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-f926d24b-38b4-4d68-a1ad-5fa81fdb0d2c tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: 0bcc1600-ecfa-4cf0-929c-03cd036d07c3] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:30.439978 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-f926d24b-38b4-4d68-a1ad-5fa81fdb0d2c tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661062780f5c45d180a05e402fc7bc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277fa3c89dff47b88894b781ff69fb70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:30.446699 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-f926d24b-38b4-4d68-a1ad-5fa81fdb0d2c tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/0bcc1600-ecfa-4cf0-929c-03cd036d07c3" status: 200 len: 1095 microversion: 2.1 time: 0.066517 Jul 05 13:07:30.447303 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 428/848] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:07:30 2022] GET /compute/v2.1/servers/0bcc1600-ecfa-4cf0-929c-03cd036d07c3 => generated 1095 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:07:30.560363 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-acd187c9-1452-4e48-bd36-2664b4b72d3f tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:30.561040 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-acd187c9-1452-4e48-bd36-2664b4b72d3f tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:30.567105 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-acd187c9-1452-4e48-bd36-2664b4b72d3f tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:30.567551 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-acd187c9-1452-4e48-bd36-2664b4b72d3f tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:30.568304 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-acd187c9-1452-4e48-bd36-2664b4b72d3f tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:30.568773 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-acd187c9-1452-4e48-bd36-2664b4b72d3f tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:30.706359 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-acd187c9-1452-4e48-bd36-2664b4b72d3f tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:30.714496 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-acd187c9-1452-4e48-bd36-2664b4b72d3f tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25" status: 200 len: 1546 microversion: 2.1 time: 0.158088 Jul 05 13:07:30.715121 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 421/849] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:07:30 2022] GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 => generated 1546 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:07:30.735072 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-1ddc6a20-f881-4334-bb8e-37c2302e640a tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:30.735654 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-1ddc6a20-f881-4334-bb8e-37c2302e640a tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:30.741818 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1ddc6a20-f881-4334-bb8e-37c2302e640a tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:30.742274 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1ddc6a20-f881-4334-bb8e-37c2302e640a tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:30.743035 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1ddc6a20-f881-4334-bb8e-37c2302e640a tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:30.743472 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1ddc6a20-f881-4334-bb8e-37c2302e640a tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:30.823926 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-1ddc6a20-f881-4334-bb8e-37c2302e640a tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092782 Jul 05 13:07:30.824516 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 429/850] 10.222.0.36 () {58 vars in 1274 bytes} [Tue Jul 5 13:07:30 2022] GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 13:07:31.464561 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-4480035b-8bed-4869-8945-e9d645d7052f tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:31.465209 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-4480035b-8bed-4869-8945-e9d645d7052f tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: 0bcc1600-ecfa-4cf0-929c-03cd036d07c3] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:31.472966 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-4480035b-8bed-4869-8945-e9d645d7052f tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:31.478000 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-4480035b-8bed-4869-8945-e9d645d7052f tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:31.478000 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-4480035b-8bed-4869-8945-e9d645d7052f tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:31.478000 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-4480035b-8bed-4869-8945-e9d645d7052f tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:31.564896 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-4480035b-8bed-4869-8945-e9d645d7052f tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661062780f5c45d180a05e402fc7bc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277fa3c89dff47b88894b781ff69fb70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:31.573313 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-4480035b-8bed-4869-8945-e9d645d7052f tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/0bcc1600-ecfa-4cf0-929c-03cd036d07c3" status: 200 len: 1145 microversion: 2.1 time: 0.113801 Jul 05 13:07:31.573896 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 422/851] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:07:31 2022] GET /compute/v2.1/servers/0bcc1600-ecfa-4cf0-929c-03cd036d07c3 => generated 1145 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:07:31.909894 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-1db68fc7-4f7f-4a4f-be08-0414587ed9dc tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:31.910740 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-1db68fc7-4f7f-4a4f-be08-0414587ed9dc tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 4c6520f9-4cce-44f6-a004-5226841dd52a] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:31.917030 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-1db68fc7-4f7f-4a4f-be08-0414587ed9dc tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:31.917469 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-1db68fc7-4f7f-4a4f-be08-0414587ed9dc tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:31.919512 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-1db68fc7-4f7f-4a4f-be08-0414587ed9dc tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:31.919951 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-1db68fc7-4f7f-4a4f-be08-0414587ed9dc tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:31.968029 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-a17620aa-b44e-48e6-b5d5-8620a243a303 req-0f8b111a-afeb-4b7d-8260-805b06cbeece service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b55ca313-2e09-4b58-b7e7-cdda74ffdd25", "tag": "10c331f6-aa21-4291-bc1b-87fa3f5495ba"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:07:31.977137 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-a17620aa-b44e-48e6-b5d5-8620a243a303 req-0f8b111a-afeb-4b7d-8260-805b06cbeece service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:31.977715 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-a17620aa-b44e-48e6-b5d5-8620a243a303 req-0f8b111a-afeb-4b7d-8260-805b06cbeece service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:31.993168 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-a17620aa-b44e-48e6-b5d5-8620a243a303 req-0f8b111a-afeb-4b7d-8260-805b06cbeece service nova] Creating event network-changed:10c331f6-aa21-4291-bc1b-87fa3f5495ba for instance b55ca313-2e09-4b58-b7e7-cdda74ffdd25 on hv-cinder-79760 Jul 05 13:07:32.001184 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-a17620aa-b44e-48e6-b5d5-8620a243a303 req-0f8b111a-afeb-4b7d-8260-805b06cbeece service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118644 Jul 05 13:07:32.002110 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 430/852] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:07:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:07:32.019010 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.objects.instance [None req-1db68fc7-4f7f-4a4f-be08-0414587ed9dc tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lazy-loading 'services' on Instance uuid 4c6520f9-4cce-44f6-a004-5226841dd52a {{(pid=118386) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 13:07:32.268552 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-1db68fc7-4f7f-4a4f-be08-0414587ed9dc tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "DELETE /compute/v2.1/servers/4c6520f9-4cce-44f6-a004-5226841dd52a/os-volume_attachments/dc400744-0864-4f45-80ca-82d0fa181ad3" status: 202 len: 0 microversion: 2.1 time: 0.362242 Jul 05 13:07:32.269198 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 423/853] 10.222.0.36 () {58 vars in 1415 bytes} [Tue Jul 5 13:07:31 2022] DELETE /compute/v2.1/servers/4c6520f9-4cce-44f6-a004-5226841dd52a/os-volume_attachments/dc400744-0864-4f45-80ca-82d0fa181ad3 => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 05 13:07:32.278070 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-a5cfeb29-b4bb-43d1-87ac-1089f6267a0b tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:32.279329 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-a5cfeb29-b4bb-43d1-87ac-1089f6267a0b tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 4c6520f9-4cce-44f6-a004-5226841dd52a] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:32.285479 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a5cfeb29-b4bb-43d1-87ac-1089f6267a0b tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:32.285932 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a5cfeb29-b4bb-43d1-87ac-1089f6267a0b tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:32.286704 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a5cfeb29-b4bb-43d1-87ac-1089f6267a0b tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:32.287144 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a5cfeb29-b4bb-43d1-87ac-1089f6267a0b tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:32.291431 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:07:32.317245 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-a5cfeb29-b4bb-43d1-87ac-1089f6267a0b tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/4c6520f9-4cce-44f6-a004-5226841dd52a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043360 Jul 05 13:07:32.317845 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 431/854] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jul 5 13:07:32 2022] GET /compute/v2.1/servers/4c6520f9-4cce-44f6-a004-5226841dd52a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:07:32.591531 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-307eaab1-55e5-46ed-acec-62255a49e0ee tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:32.592225 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-307eaab1-55e5-46ed-acec-62255a49e0ee tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: 0bcc1600-ecfa-4cf0-929c-03cd036d07c3] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:32.598669 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-307eaab1-55e5-46ed-acec-62255a49e0ee tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:32.599115 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-307eaab1-55e5-46ed-acec-62255a49e0ee tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:32.599876 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-307eaab1-55e5-46ed-acec-62255a49e0ee tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:32.600305 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-307eaab1-55e5-46ed-acec-62255a49e0ee tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:32.668553 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-307eaab1-55e5-46ed-acec-62255a49e0ee tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661062780f5c45d180a05e402fc7bc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277fa3c89dff47b88894b781ff69fb70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:32.676478 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-307eaab1-55e5-46ed-acec-62255a49e0ee tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/0bcc1600-ecfa-4cf0-929c-03cd036d07c3" status: 200 len: 1201 microversion: 2.1 time: 0.089472 Jul 05 13:07:32.677242 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 424/855] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:07:32 2022] GET /compute/v2.1/servers/0bcc1600-ecfa-4cf0-929c-03cd036d07c3 => generated 1201 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:07:33.329286 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-f37734f8-b1b9-41c8-a218-a06b49b84ecb tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:33.330208 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-f37734f8-b1b9-41c8-a218-a06b49b84ecb tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 4c6520f9-4cce-44f6-a004-5226841dd52a] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:33.337605 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f37734f8-b1b9-41c8-a218-a06b49b84ecb tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:33.338058 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f37734f8-b1b9-41c8-a218-a06b49b84ecb tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:33.338827 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f37734f8-b1b9-41c8-a218-a06b49b84ecb tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:33.339272 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f37734f8-b1b9-41c8-a218-a06b49b84ecb tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:33.369503 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-f37734f8-b1b9-41c8-a218-a06b49b84ecb tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/4c6520f9-4cce-44f6-a004-5226841dd52a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044264 Jul 05 13:07:33.370076 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 432/856] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jul 5 13:07:33 2022] GET /compute/v2.1/servers/4c6520f9-4cce-44f6-a004-5226841dd52a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:07:33.694153 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-9a6f5036-ca45-4e50-974a-5abfd678487c tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:33.694697 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-9a6f5036-ca45-4e50-974a-5abfd678487c tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: 0bcc1600-ecfa-4cf0-929c-03cd036d07c3] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:33.701168 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-9a6f5036-ca45-4e50-974a-5abfd678487c tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:33.701651 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-9a6f5036-ca45-4e50-974a-5abfd678487c tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:33.702381 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-9a6f5036-ca45-4e50-974a-5abfd678487c tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:33.702816 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-9a6f5036-ca45-4e50-974a-5abfd678487c tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:33.766210 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-9a6f5036-ca45-4e50-974a-5abfd678487c tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661062780f5c45d180a05e402fc7bc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277fa3c89dff47b88894b781ff69fb70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:33.774033 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-9a6f5036-ca45-4e50-974a-5abfd678487c tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/0bcc1600-ecfa-4cf0-929c-03cd036d07c3" status: 200 len: 1211 microversion: 2.1 time: 0.083828 Jul 05 13:07:33.774599 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 425/857] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:07:33 2022] GET /compute/v2.1/servers/0bcc1600-ecfa-4cf0-929c-03cd036d07c3 => generated 1211 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:07:34.381932 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-daa39df0-f7fb-425d-a94d-bbaeb81ca5aa tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:34.383361 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-daa39df0-f7fb-425d-a94d-bbaeb81ca5aa tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 4c6520f9-4cce-44f6-a004-5226841dd52a] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:34.392605 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-daa39df0-f7fb-425d-a94d-bbaeb81ca5aa tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:34.392605 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-daa39df0-f7fb-425d-a94d-bbaeb81ca5aa tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:34.392605 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-daa39df0-f7fb-425d-a94d-bbaeb81ca5aa tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:34.392605 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-daa39df0-f7fb-425d-a94d-bbaeb81ca5aa tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:34.420775 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-daa39df0-f7fb-425d-a94d-bbaeb81ca5aa tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/4c6520f9-4cce-44f6-a004-5226841dd52a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043112 Jul 05 13:07:34.421429 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 433/858] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jul 5 13:07:34 2022] GET /compute/v2.1/servers/4c6520f9-4cce-44f6-a004-5226841dd52a/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 05 13:07:34.479745 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-669fb5ac-5320-4b56-9bbb-edb39afb185b tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:34.480466 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-669fb5ac-5320-4b56-9bbb-edb39afb185b tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 4c6520f9-4cce-44f6-a004-5226841dd52a] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:34.486445 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-669fb5ac-5320-4b56-9bbb-edb39afb185b tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:34.486958 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-669fb5ac-5320-4b56-9bbb-edb39afb185b tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:34.487646 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-669fb5ac-5320-4b56-9bbb-edb39afb185b tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:34.488074 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-669fb5ac-5320-4b56-9bbb-edb39afb185b tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:34.512812 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-669fb5ac-5320-4b56-9bbb-edb39afb185b tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 4c6520f9-4cce-44f6-a004-5226841dd52a] Going to try to terminate instance {{(pid=118386) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 13:07:34.634539 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:07:34.792812 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-31a73f42-3d04-40d8-8273-3c86205d5184 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:34.793536 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-31a73f42-3d04-40d8-8273-3c86205d5184 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: 0bcc1600-ecfa-4cf0-929c-03cd036d07c3] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:34.799894 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-31a73f42-3d04-40d8-8273-3c86205d5184 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:34.800282 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-31a73f42-3d04-40d8-8273-3c86205d5184 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:34.801335 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-31a73f42-3d04-40d8-8273-3c86205d5184 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:34.801509 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-31a73f42-3d04-40d8-8273-3c86205d5184 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:34.829916 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-669fb5ac-5320-4b56-9bbb-edb39afb185b tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "DELETE /compute/v2.1/servers/4c6520f9-4cce-44f6-a004-5226841dd52a" status: 204 len: 0 microversion: 2.1 time: 0.353912 Jul 05 13:07:34.833314 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 426/859] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jul 5 13:07:34 2022] DELETE /compute/v2.1/servers/4c6520f9-4cce-44f6-a004-5226841dd52a => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 05 13:07:34.841927 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-4519b51c-d1c3-458a-a508-3827f8a6a348 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:34.845838 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-4519b51c-d1c3-458a-a508-3827f8a6a348 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 4c6520f9-4cce-44f6-a004-5226841dd52a] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:34.848886 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-4519b51c-d1c3-458a-a508-3827f8a6a348 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:34.849332 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-4519b51c-d1c3-458a-a508-3827f8a6a348 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:34.850098 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-4519b51c-d1c3-458a-a508-3827f8a6a348 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:34.850719 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-4519b51c-d1c3-458a-a508-3827f8a6a348 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:34.998769 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-31a73f42-3d04-40d8-8273-3c86205d5184 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661062780f5c45d180a05e402fc7bc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277fa3c89dff47b88894b781ff69fb70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:35.006662 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-31a73f42-3d04-40d8-8273-3c86205d5184 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/0bcc1600-ecfa-4cf0-929c-03cd036d07c3" status: 200 len: 1266 microversion: 2.1 time: 0.217995 Jul 05 13:07:35.014572 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 434/860] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:07:34 2022] GET /compute/v2.1/servers/0bcc1600-ecfa-4cf0-929c-03cd036d07c3 => generated 1266 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:07:35.014572 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-513cd77f-b1e2-4027-9bcc-a42bee9bfb17 req-28ae7212-9949-4aba-8c42-241250fb29d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bcc1600-ecfa-4cf0-929c-03cd036d07c3", "tag": "d010e1f8-d442-4111-a65d-8c9e9e080c9f"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:07:35.022448 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-513cd77f-b1e2-4027-9bcc-a42bee9bfb17 req-28ae7212-9949-4aba-8c42-241250fb29d1 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:35.023079 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-513cd77f-b1e2-4027-9bcc-a42bee9bfb17 req-28ae7212-9949-4aba-8c42-241250fb29d1 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:35.034197 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-513cd77f-b1e2-4027-9bcc-a42bee9bfb17 req-28ae7212-9949-4aba-8c42-241250fb29d1 service nova] Creating event network-changed:d010e1f8-d442-4111-a65d-8c9e9e080c9f for instance 0bcc1600-ecfa-4cf0-929c-03cd036d07c3 on hv-cinder-79760 Jul 05 13:07:35.036520 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-4519b51c-d1c3-458a-a508-3827f8a6a348 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:35.039041 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-513cd77f-b1e2-4027-9bcc-a42bee9bfb17 req-28ae7212-9949-4aba-8c42-241250fb29d1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029959 Jul 05 13:07:35.039891 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 435/861] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:07:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:07:35.045208 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-4519b51c-d1c3-458a-a508-3827f8a6a348 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/4c6520f9-4cce-44f6-a004-5226841dd52a" status: 200 len: 1681 microversion: 2.1 time: 0.207661 Jul 05 13:07:35.045886 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 427/862] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:07:34 2022] GET /compute/v2.1/servers/4c6520f9-4cce-44f6-a004-5226841dd52a => generated 1681 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:07:36.025776 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-7e03bea8-0f61-44a1-b6e5-6f7d5fd7d6d4 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:36.026476 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-7e03bea8-0f61-44a1-b6e5-6f7d5fd7d6d4 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: 0bcc1600-ecfa-4cf0-929c-03cd036d07c3] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:36.032719 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7e03bea8-0f61-44a1-b6e5-6f7d5fd7d6d4 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:36.033175 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7e03bea8-0f61-44a1-b6e5-6f7d5fd7d6d4 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:36.033940 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7e03bea8-0f61-44a1-b6e5-6f7d5fd7d6d4 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:36.034382 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7e03bea8-0f61-44a1-b6e5-6f7d5fd7d6d4 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:36.062695 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-195a4d2b-dec6-4d65-aa96-0e5f84a65591 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:36.063902 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-195a4d2b-dec6-4d65-aa96-0e5f84a65591 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 4c6520f9-4cce-44f6-a004-5226841dd52a] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:36.070992 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-195a4d2b-dec6-4d65-aa96-0e5f84a65591 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:36.071507 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-195a4d2b-dec6-4d65-aa96-0e5f84a65591 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:36.072369 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-195a4d2b-dec6-4d65-aa96-0e5f84a65591 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:36.072895 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-195a4d2b-dec6-4d65-aa96-0e5f84a65591 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:36.217601 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-7e03bea8-0f61-44a1-b6e5-6f7d5fd7d6d4 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661062780f5c45d180a05e402fc7bc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277fa3c89dff47b88894b781ff69fb70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:36.225073 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-7e03bea8-0f61-44a1-b6e5-6f7d5fd7d6d4 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/0bcc1600-ecfa-4cf0-929c-03cd036d07c3" status: 200 len: 1266 microversion: 2.1 time: 0.204461 Jul 05 13:07:36.226084 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 436/863] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:07:36 2022] GET /compute/v2.1/servers/0bcc1600-ecfa-4cf0-929c-03cd036d07c3 => generated 1266 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:07:36.244958 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-195a4d2b-dec6-4d65-aa96-0e5f84a65591 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:36.252496 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-195a4d2b-dec6-4d65-aa96-0e5f84a65591 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/4c6520f9-4cce-44f6-a004-5226841dd52a" status: 200 len: 1681 microversion: 2.1 time: 0.193576 Jul 05 13:07:36.253102 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 428/864] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:07:36 2022] GET /compute/v2.1/servers/4c6520f9-4cce-44f6-a004-5226841dd52a => generated 1681 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:07:37.242449 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-8f6cbf4e-9809-4b88-846f-8d464a54b8e4 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:37.243260 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-8f6cbf4e-9809-4b88-846f-8d464a54b8e4 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: 0bcc1600-ecfa-4cf0-929c-03cd036d07c3] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:37.250103 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8f6cbf4e-9809-4b88-846f-8d464a54b8e4 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:37.250584 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8f6cbf4e-9809-4b88-846f-8d464a54b8e4 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:37.251354 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8f6cbf4e-9809-4b88-846f-8d464a54b8e4 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:37.251819 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8f6cbf4e-9809-4b88-846f-8d464a54b8e4 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:37.270691 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-2255a146-0ee7-43b7-94a5-8b655cbe16c1 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:37.271342 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-2255a146-0ee7-43b7-94a5-8b655cbe16c1 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 4c6520f9-4cce-44f6-a004-5226841dd52a] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:37.278301 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-2255a146-0ee7-43b7-94a5-8b655cbe16c1 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:37.278951 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-2255a146-0ee7-43b7-94a5-8b655cbe16c1 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:37.279878 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-2255a146-0ee7-43b7-94a5-8b655cbe16c1 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:37.280307 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-2255a146-0ee7-43b7-94a5-8b655cbe16c1 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:37.442340 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-8f6cbf4e-9809-4b88-846f-8d464a54b8e4 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661062780f5c45d180a05e402fc7bc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277fa3c89dff47b88894b781ff69fb70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:37.449938 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-8f6cbf4e-9809-4b88-846f-8d464a54b8e4 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/0bcc1600-ecfa-4cf0-929c-03cd036d07c3" status: 200 len: 1266 microversion: 2.1 time: 0.211499 Jul 05 13:07:37.450567 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 437/865] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:07:37 2022] GET /compute/v2.1/servers/0bcc1600-ecfa-4cf0-929c-03cd036d07c3 => generated 1266 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:07:37.468221 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-2255a146-0ee7-43b7-94a5-8b655cbe16c1 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:37.475807 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-2255a146-0ee7-43b7-94a5-8b655cbe16c1 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/4c6520f9-4cce-44f6-a004-5226841dd52a" status: 200 len: 1681 microversion: 2.1 time: 0.209286 Jul 05 13:07:37.476836 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 429/866] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:07:37 2022] GET /compute/v2.1/servers/4c6520f9-4cce-44f6-a004-5226841dd52a => generated 1681 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:07:37.990338 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-3c80ea67-062d-4ac9-91c1-77c877ea8cc4 req-8515d95b-7f9e-42ca-b667-ed32de10a4b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c6520f9-4cce-44f6-a004-5226841dd52a", "name": "network-vif-deleted", "tag": "0c693613-12ee-4f41-b9c6-7821cfee92f4"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:07:37.998978 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-3c80ea67-062d-4ac9-91c1-77c877ea8cc4 req-8515d95b-7f9e-42ca-b667-ed32de10a4b3 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:37.999424 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-3c80ea67-062d-4ac9-91c1-77c877ea8cc4 req-8515d95b-7f9e-42ca-b667-ed32de10a4b3 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:38.010847 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-3c80ea67-062d-4ac9-91c1-77c877ea8cc4 req-8515d95b-7f9e-42ca-b667-ed32de10a4b3 service nova] Creating event network-vif-deleted:0c693613-12ee-4f41-b9c6-7821cfee92f4 for instance 4c6520f9-4cce-44f6-a004-5226841dd52a on hv-cinder-79760 Jul 05 13:07:38.015854 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-3c80ea67-062d-4ac9-91c1-77c877ea8cc4 req-8515d95b-7f9e-42ca-b667-ed32de10a4b3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029644 Jul 05 13:07:38.016449 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 438/867] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:07:38.467522 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-d07189f3-406e-4a69-bd08-bf78e164b1ff tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:38.468136 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-d07189f3-406e-4a69-bd08-bf78e164b1ff tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: 0bcc1600-ecfa-4cf0-929c-03cd036d07c3] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:38.470696 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:07:38.475651 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-d07189f3-406e-4a69-bd08-bf78e164b1ff tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:38.476783 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-d07189f3-406e-4a69-bd08-bf78e164b1ff tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:38.477562 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-d07189f3-406e-4a69-bd08-bf78e164b1ff tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:38.477997 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-d07189f3-406e-4a69-bd08-bf78e164b1ff tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:38.494843 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-96eb7607-3422-4b12-aaac-773af9d65f5c tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:38.495551 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-96eb7607-3422-4b12-aaac-773af9d65f5c tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 4c6520f9-4cce-44f6-a004-5226841dd52a] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:38.502207 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-96eb7607-3422-4b12-aaac-773af9d65f5c tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:38.502666 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-96eb7607-3422-4b12-aaac-773af9d65f5c tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:38.503598 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-96eb7607-3422-4b12-aaac-773af9d65f5c tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:38.504048 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-96eb7607-3422-4b12-aaac-773af9d65f5c tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:38.548988 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-96eb7607-3422-4b12-aaac-773af9d65f5c tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:38.549435 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-96eb7607-3422-4b12-aaac-773af9d65f5c tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:38.549890 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.objects.instance [None req-96eb7607-3422-4b12-aaac-773af9d65f5c tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lazy-loading 'fault' on Instance uuid 4c6520f9-4cce-44f6-a004-5226841dd52a {{(pid=118387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 13:07:38.608885 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-96eb7607-3422-4b12-aaac-773af9d65f5c tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa97e27060b3429bbad061a256db19f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163f0d5f47be49f493296f228d1080a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:38.618055 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-96eb7607-3422-4b12-aaac-773af9d65f5c tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/4c6520f9-4cce-44f6-a004-5226841dd52a" status: 200 len: 1331 microversion: 2.1 time: 0.128149 Jul 05 13:07:38.618641 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 439/868] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:07:38 2022] GET /compute/v2.1/servers/4c6520f9-4cce-44f6-a004-5226841dd52a => generated 1331 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:07:38.641388 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-d07189f3-406e-4a69-bd08-bf78e164b1ff tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661062780f5c45d180a05e402fc7bc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277fa3c89dff47b88894b781ff69fb70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:38.650984 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-d07189f3-406e-4a69-bd08-bf78e164b1ff tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/0bcc1600-ecfa-4cf0-929c-03cd036d07c3" status: 200 len: 1266 microversion: 2.1 time: 0.187286 Jul 05 13:07:38.651586 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 430/869] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:07:38 2022] GET /compute/v2.1/servers/0bcc1600-ecfa-4cf0-929c-03cd036d07c3 => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:07:39.635374 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-ce1dc633-a6f6-4aff-84f3-9d48351ba455 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:39.636084 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-ce1dc633-a6f6-4aff-84f3-9d48351ba455 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 4c6520f9-4cce-44f6-a004-5226841dd52a] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:39.642629 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ce1dc633-a6f6-4aff-84f3-9d48351ba455 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:39.643073 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ce1dc633-a6f6-4aff-84f3-9d48351ba455 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:39.643826 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ce1dc633-a6f6-4aff-84f3-9d48351ba455 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:39.644254 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ce1dc633-a6f6-4aff-84f3-9d48351ba455 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:39.657964 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.wsgi [None req-ce1dc633-a6f6-4aff-84f3-9d48351ba455 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] HTTP exception thrown: Instance 4c6520f9-4cce-44f6-a004-5226841dd52a could not be found. Jul 05 13:07:39.659619 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-ce1dc633-a6f6-4aff-84f3-9d48351ba455 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Request method failure captured: Jul 05 13:07:39.659619 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: request: GET /compute/v2.1/servers/4c6520f9-4cce-44f6-a004-5226841dd52a HTTP/1.1 Jul 05 13:07:39.659619 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept: application/json Jul 05 13:07:39.659619 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept-Encoding: identity Jul 05 13:07:39.659619 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Connection: close Jul 05 13:07:39.659619 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Length: 0 Jul 05 13:07:39.659619 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Type: application/json Jul 05 13:07:39.659619 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Host: 10.222.0.36 Jul 05 13:07:39.659619 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Openstack-System-Scope: None Jul 05 13:07:39.659619 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: User-Agent: python-urllib3/1.26.9 Jul 05 13:07:39.659619 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Auth-Token: gAAAAABixDYWQWL8uJCqum4c6BlnNfbR703HW4HnpwW8iX1I1pbqlc_QGnJWLD1G-z_DKnfPJbbyyKcDC4sR005HdVrBcj6np6lEImplVRPpD09FwDfrBAC23lqXzO2ZdNTX7uxeDP3sMtbJ8KEd2t_ks3LspqcGELiRwc6BksJqjl4JxwirzAA Jul 05 13:07:39.659619 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Id: None Jul 05 13:07:39.659619 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Name: None Jul 05 13:07:39.659619 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Identity-Status: Confirmed Jul 05 13:07:39.659619 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Is-Admin-Project: True Jul 05 13:07:39.659619 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Id: default Jul 05 13:07:39.659619 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Name: Default Jul 05 13:07:39.659619 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Id: 163f0d5f47be49f493296f228d1080a5 Jul 05 13:07:39.659619 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Name: tempest-AttachVolumeNegativeTest-1554059375 Jul 05 13:07:39.659619 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Role: member,reader Jul 05 13:07:39.659619 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Roles: member,reader Jul 05 13:07:39.665061 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/163f0d5f47be49f493296f228d1080a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_163f0d5f47be49f493296f228d1080a5", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/163f0d5f47be49f493296f228d1080a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/163f0d5f47be49f493296f228d1080a5"}]}] Jul 05 13:07:39.665061 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant: tempest-AttachVolumeNegativeTest-1554059375 Jul 05 13:07:39.665061 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Id: 163f0d5f47be49f493296f228d1080a5 Jul 05 13:07:39.665061 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1554059375 Jul 05 13:07:39.665061 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User: tempest-AttachVolumeNegativeTest-1554059375-project Jul 05 13:07:39.665061 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Id: default Jul 05 13:07:39.665061 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Name: Default Jul 05 13:07:39.665061 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Id: aa97e27060b3429bbad061a256db19f1 Jul 05 13:07:39.665061 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Name: tempest-AttachVolumeNegativeTest-1554059375-project Jul 05 13:07:39.665061 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: method: > Jul 05 13:07:39.665061 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: exception: Instance 4c6520f9-4cce-44f6-a004-5226841dd52a could not be found. Jul 05 13:07:39.665061 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: action_args: {'id': '4c6520f9-4cce-44f6-a004-5226841dd52a'} Jul 05 13:07:39.665985 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 13:07:39.665985 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:07:39.665985 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 13:07:39.665985 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 13:07:39.665985 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 13:07:39.665985 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 13:07:39.665985 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 13:07:39.665985 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 13:07:39.665985 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 13:07:39.665985 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 13:07:39.665985 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c6520f9-4cce-44f6-a004-5226841dd52a could not be found. Jul 05 13:07:39.665985 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:07:39.665985 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:07:39.665985 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:07:39.665985 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:07:39.665985 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:07:39.665985 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:07:39.665985 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 13:07:39.665985 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 13:07:39.665985 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 13:07:39.667439 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 13:07:39.667439 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 13:07:39.667439 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 13:07:39.667439 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 13:07:39.667439 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 13:07:39.667439 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 13:07:39.667439 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 13:07:39.667439 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c6520f9-4cce-44f6-a004-5226841dd52a could not be found. Jul 05 13:07:39.667439 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:07:39.667439 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:07:39.667439 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:07:39.667439 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:07:39.667439 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:07:39.667439 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:07:39.667439 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 13:07:39.667439 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 13:07:39.667439 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c6520f9-4cce-44f6-a004-5226841dd52a could not be found. Jul 05 13:07:39.667439 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:07:39.668791 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-ce1dc633-a6f6-4aff-84f3-9d48351ba455 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Returning 404 to user: Instance 4c6520f9-4cce-44f6-a004-5226841dd52a could not be found. {{(pid=118387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 13:07:39.668791 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-ce1dc633-a6f6-4aff-84f3-9d48351ba455 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/4c6520f9-4cce-44f6-a004-5226841dd52a" status: 404 len: 111 microversion: 2.1 time: 0.029985 Jul 05 13:07:39.668791 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 440/870] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:07:39 2022] GET /compute/v2.1/servers/4c6520f9-4cce-44f6-a004-5226841dd52a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 13:07:39.669883 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-79cc5787-5a8a-4c29-b25d-9e51e3865b4d tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '.version_select at 0x7f70de5e9ca0>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:39.677170 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-ac0ae1d8-f769-46b4-895b-9145f9acc8be tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:39.677793 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-ac0ae1d8-f769-46b4-895b-9145f9acc8be tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: 0bcc1600-ecfa-4cf0-929c-03cd036d07c3] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:39.684074 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ac0ae1d8-f769-46b4-895b-9145f9acc8be tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:39.684558 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ac0ae1d8-f769-46b4-895b-9145f9acc8be tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:39.685452 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ac0ae1d8-f769-46b4-895b-9145f9acc8be tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:39.685913 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ac0ae1d8-f769-46b4-895b-9145f9acc8be tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:39.813407 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-79cc5787-5a8a-4c29-b25d-9e51e3865b4d tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1866201714" status: 202 len: 0 microversion: 2.1 time: 0.147152 Jul 05 13:07:39.813997 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 431/871] 10.222.0.36 () {58 vars in 1220 bytes} [Tue Jul 5 13:07:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1866201714 => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 13:07:39.817896 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-ac0ae1d8-f769-46b4-895b-9145f9acc8be tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661062780f5c45d180a05e402fc7bc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277fa3c89dff47b88894b781ff69fb70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:39.825455 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-ac0ae1d8-f769-46b4-895b-9145f9acc8be tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/0bcc1600-ecfa-4cf0-929c-03cd036d07c3" status: 200 len: 1266 microversion: 2.1 time: 0.152827 Jul 05 13:07:39.826041 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 441/872] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:07:39 2022] GET /compute/v2.1/servers/0bcc1600-ecfa-4cf0-929c-03cd036d07c3 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:07:40.842157 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-0f2d95e0-9b3e-4d9f-adec-166a7377e800 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:40.842843 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-0f2d95e0-9b3e-4d9f-adec-166a7377e800 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: 0bcc1600-ecfa-4cf0-929c-03cd036d07c3] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:40.845253 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_cell0:SELECT=2 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:07:40.845975 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_cell0:SELECT=6 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:07:40.854661 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-0f2d95e0-9b3e-4d9f-adec-166a7377e800 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:40.856867 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-0f2d95e0-9b3e-4d9f-adec-166a7377e800 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:40.857719 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-0f2d95e0-9b3e-4d9f-adec-166a7377e800 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:40.858189 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-0f2d95e0-9b3e-4d9f-adec-166a7377e800 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:41.002820 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-0f2d95e0-9b3e-4d9f-adec-166a7377e800 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661062780f5c45d180a05e402fc7bc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277fa3c89dff47b88894b781ff69fb70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:41.011122 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-0f2d95e0-9b3e-4d9f-adec-166a7377e800 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/0bcc1600-ecfa-4cf0-929c-03cd036d07c3" status: 200 len: 1266 microversion: 2.1 time: 0.173598 Jul 05 13:07:41.011683 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 432/873] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:07:40 2022] GET /compute/v2.1/servers/0bcc1600-ecfa-4cf0-929c-03cd036d07c3 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:07:41.892671 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-2c1a0bb0-0037-434c-9919-85fc8c070396 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:41.893182 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-2c1a0bb0-0037-434c-9919-85fc8c070396 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 4c6520f9-4cce-44f6-a004-5226841dd52a] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:41.895117 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell0:SELECT=2 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:07:41.896896 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:07:41.902297 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2c1a0bb0-0037-434c-9919-85fc8c070396 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:41.902745 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2c1a0bb0-0037-434c-9919-85fc8c070396 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:41.903512 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2c1a0bb0-0037-434c-9919-85fc8c070396 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:41.903948 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2c1a0bb0-0037-434c-9919-85fc8c070396 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:41.916968 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.wsgi [None req-2c1a0bb0-0037-434c-9919-85fc8c070396 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] HTTP exception thrown: Instance 4c6520f9-4cce-44f6-a004-5226841dd52a could not be found. Jul 05 13:07:41.918543 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-2c1a0bb0-0037-434c-9919-85fc8c070396 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Request method failure captured: Jul 05 13:07:41.918543 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: request: DELETE /compute/v2.1/servers/4c6520f9-4cce-44f6-a004-5226841dd52a HTTP/1.1 Jul 05 13:07:41.918543 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept: application/json Jul 05 13:07:41.918543 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept-Encoding: identity Jul 05 13:07:41.918543 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Connection: close Jul 05 13:07:41.918543 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Length: 0 Jul 05 13:07:41.918543 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Type: application/json Jul 05 13:07:41.918543 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Host: 10.222.0.36 Jul 05 13:07:41.918543 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Openstack-System-Scope: None Jul 05 13:07:41.918543 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: User-Agent: python-urllib3/1.26.9 Jul 05 13:07:41.918543 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Auth-Token: gAAAAABixDYWQWL8uJCqum4c6BlnNfbR703HW4HnpwW8iX1I1pbqlc_QGnJWLD1G-z_DKnfPJbbyyKcDC4sR005HdVrBcj6np6lEImplVRPpD09FwDfrBAC23lqXzO2ZdNTX7uxeDP3sMtbJ8KEd2t_ks3LspqcGELiRwc6BksJqjl4JxwirzAA Jul 05 13:07:41.918543 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Id: None Jul 05 13:07:41.918543 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Name: None Jul 05 13:07:41.918543 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Identity-Status: Confirmed Jul 05 13:07:41.918543 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Is-Admin-Project: True Jul 05 13:07:41.918543 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Id: default Jul 05 13:07:41.918543 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Name: Default Jul 05 13:07:41.918543 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Id: 163f0d5f47be49f493296f228d1080a5 Jul 05 13:07:41.918543 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Name: tempest-AttachVolumeNegativeTest-1554059375 Jul 05 13:07:41.918543 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Role: member,reader Jul 05 13:07:41.918543 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Roles: member,reader Jul 05 13:07:41.920108 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/163f0d5f47be49f493296f228d1080a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_163f0d5f47be49f493296f228d1080a5", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/163f0d5f47be49f493296f228d1080a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/163f0d5f47be49f493296f228d1080a5"}]}] Jul 05 13:07:41.920108 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant: tempest-AttachVolumeNegativeTest-1554059375 Jul 05 13:07:41.920108 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Id: 163f0d5f47be49f493296f228d1080a5 Jul 05 13:07:41.920108 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1554059375 Jul 05 13:07:41.920108 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User: tempest-AttachVolumeNegativeTest-1554059375-project Jul 05 13:07:41.920108 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Id: default Jul 05 13:07:41.920108 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Name: Default Jul 05 13:07:41.920108 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Id: aa97e27060b3429bbad061a256db19f1 Jul 05 13:07:41.920108 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Name: tempest-AttachVolumeNegativeTest-1554059375-project Jul 05 13:07:41.920108 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: method: > Jul 05 13:07:41.920108 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: exception: Instance 4c6520f9-4cce-44f6-a004-5226841dd52a could not be found. Jul 05 13:07:41.920108 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: action_args: {'id': '4c6520f9-4cce-44f6-a004-5226841dd52a'} Jul 05 13:07:41.921038 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 13:07:41.921038 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:07:41.921038 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 13:07:41.921038 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 13:07:41.921038 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 13:07:41.921038 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 13:07:41.921038 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 13:07:41.921038 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 13:07:41.921038 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 13:07:41.921038 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 13:07:41.921038 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c6520f9-4cce-44f6-a004-5226841dd52a could not be found. Jul 05 13:07:41.921038 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:07:41.921038 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:07:41.921038 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:07:41.921038 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:07:41.921038 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:07:41.921038 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:07:41.921038 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 13:07:41.921038 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 13:07:41.921038 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 13:07:41.922346 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 13:07:41.922346 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 05 13:07:41.922346 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 05 13:07:41.922346 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 05 13:07:41.922346 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 05 13:07:41.922346 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 13:07:41.922346 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 13:07:41.922346 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 13:07:41.922346 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 13:07:41.922346 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c6520f9-4cce-44f6-a004-5226841dd52a could not be found. Jul 05 13:07:41.922346 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:07:41.922346 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:07:41.922346 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:07:41.922346 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:07:41.922346 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:07:41.922346 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:07:41.922346 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 13:07:41.922346 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 13:07:41.922346 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c6520f9-4cce-44f6-a004-5226841dd52a could not be found. Jul 05 13:07:41.922346 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:07:41.923681 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-2c1a0bb0-0037-434c-9919-85fc8c070396 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Returning 404 to user: Instance 4c6520f9-4cce-44f6-a004-5226841dd52a could not be found. {{(pid=118387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 13:07:41.923681 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-2c1a0bb0-0037-434c-9919-85fc8c070396 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "DELETE /compute/v2.1/servers/4c6520f9-4cce-44f6-a004-5226841dd52a" status: 404 len: 111 microversion: 2.1 time: 0.031200 Jul 05 13:07:41.923681 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 442/874] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jul 5 13:07:41 2022] DELETE /compute/v2.1/servers/4c6520f9-4cce-44f6-a004-5226841dd52a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 13:07:41.928539 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-a4d0c981-aed0-44f1-b69e-4b2735eb67f7 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:41.929177 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-a4d0c981-aed0-44f1-b69e-4b2735eb67f7 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 4c6520f9-4cce-44f6-a004-5226841dd52a] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:41.936013 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a4d0c981-aed0-44f1-b69e-4b2735eb67f7 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:41.936455 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a4d0c981-aed0-44f1-b69e-4b2735eb67f7 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:41.941109 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a4d0c981-aed0-44f1-b69e-4b2735eb67f7 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:41.941109 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a4d0c981-aed0-44f1-b69e-4b2735eb67f7 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:41.953659 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.wsgi [None req-a4d0c981-aed0-44f1-b69e-4b2735eb67f7 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] HTTP exception thrown: Instance 4c6520f9-4cce-44f6-a004-5226841dd52a could not be found. Jul 05 13:07:41.955650 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-a4d0c981-aed0-44f1-b69e-4b2735eb67f7 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Request method failure captured: Jul 05 13:07:41.955650 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: request: GET /compute/v2.1/servers/4c6520f9-4cce-44f6-a004-5226841dd52a HTTP/1.1 Jul 05 13:07:41.955650 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Accept: application/json Jul 05 13:07:41.955650 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Accept-Encoding: identity Jul 05 13:07:41.955650 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Connection: close Jul 05 13:07:41.955650 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Content-Length: 0 Jul 05 13:07:41.955650 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Content-Type: application/json Jul 05 13:07:41.955650 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Host: 10.222.0.36 Jul 05 13:07:41.955650 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Openstack-System-Scope: None Jul 05 13:07:41.955650 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: User-Agent: python-urllib3/1.26.9 Jul 05 13:07:41.955650 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Auth-Token: gAAAAABixDYWQWL8uJCqum4c6BlnNfbR703HW4HnpwW8iX1I1pbqlc_QGnJWLD1G-z_DKnfPJbbyyKcDC4sR005HdVrBcj6np6lEImplVRPpD09FwDfrBAC23lqXzO2ZdNTX7uxeDP3sMtbJ8KEd2t_ks3LspqcGELiRwc6BksJqjl4JxwirzAA Jul 05 13:07:41.955650 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Domain-Id: None Jul 05 13:07:41.955650 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Domain-Name: None Jul 05 13:07:41.955650 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Identity-Status: Confirmed Jul 05 13:07:41.955650 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Is-Admin-Project: True Jul 05 13:07:41.955650 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Domain-Id: default Jul 05 13:07:41.955650 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Domain-Name: Default Jul 05 13:07:41.955650 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Id: 163f0d5f47be49f493296f228d1080a5 Jul 05 13:07:41.955650 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Name: tempest-AttachVolumeNegativeTest-1554059375 Jul 05 13:07:41.955650 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Role: member,reader Jul 05 13:07:41.955650 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Roles: member,reader Jul 05 13:07:41.957309 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/163f0d5f47be49f493296f228d1080a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_163f0d5f47be49f493296f228d1080a5", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/163f0d5f47be49f493296f228d1080a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/163f0d5f47be49f493296f228d1080a5"}]}] Jul 05 13:07:41.957309 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Tenant: tempest-AttachVolumeNegativeTest-1554059375 Jul 05 13:07:41.957309 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Tenant-Id: 163f0d5f47be49f493296f228d1080a5 Jul 05 13:07:41.957309 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1554059375 Jul 05 13:07:41.957309 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User: tempest-AttachVolumeNegativeTest-1554059375-project Jul 05 13:07:41.957309 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Domain-Id: default Jul 05 13:07:41.957309 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Domain-Name: Default Jul 05 13:07:41.957309 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Id: aa97e27060b3429bbad061a256db19f1 Jul 05 13:07:41.957309 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Name: tempest-AttachVolumeNegativeTest-1554059375-project Jul 05 13:07:41.957309 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: method: > Jul 05 13:07:41.957309 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: exception: Instance 4c6520f9-4cce-44f6-a004-5226841dd52a could not be found. Jul 05 13:07:41.957309 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: action_args: {'id': '4c6520f9-4cce-44f6-a004-5226841dd52a'} Jul 05 13:07:41.958170 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 13:07:41.958170 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:07:41.958170 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 13:07:41.958170 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 13:07:41.958170 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 13:07:41.958170 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 13:07:41.958170 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 13:07:41.958170 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 13:07:41.958170 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 13:07:41.958170 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 13:07:41.958170 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c6520f9-4cce-44f6-a004-5226841dd52a could not be found. Jul 05 13:07:41.958170 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:07:41.958170 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:07:41.958170 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:07:41.958170 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:07:41.958170 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:07:41.958170 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:07:41.958170 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 13:07:41.958170 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 13:07:41.958170 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 13:07:41.959890 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 13:07:41.959890 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 13:07:41.959890 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 13:07:41.959890 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 13:07:41.959890 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 13:07:41.959890 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 13:07:41.959890 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 13:07:41.959890 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c6520f9-4cce-44f6-a004-5226841dd52a could not be found. Jul 05 13:07:41.959890 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:07:41.959890 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:07:41.959890 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:07:41.959890 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:07:41.959890 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:07:41.959890 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:07:41.959890 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 13:07:41.959890 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 13:07:41.959890 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c6520f9-4cce-44f6-a004-5226841dd52a could not be found. Jul 05 13:07:41.959890 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:07:41.961721 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-a4d0c981-aed0-44f1-b69e-4b2735eb67f7 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Returning 404 to user: Instance 4c6520f9-4cce-44f6-a004-5226841dd52a could not be found. {{(pid=118386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 13:07:41.961721 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-a4d0c981-aed0-44f1-b69e-4b2735eb67f7 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/4c6520f9-4cce-44f6-a004-5226841dd52a" status: 404 len: 111 microversion: 2.1 time: 0.032312 Jul 05 13:07:41.961721 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 433/875] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:07:41 2022] GET /compute/v2.1/servers/4c6520f9-4cce-44f6-a004-5226841dd52a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 13:07:42.028521 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-48fbeff9-ec9d-4288-a05b-359f955fc39e tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:42.029167 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-48fbeff9-ec9d-4288-a05b-359f955fc39e tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: 0bcc1600-ecfa-4cf0-929c-03cd036d07c3] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:42.036245 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-48fbeff9-ec9d-4288-a05b-359f955fc39e tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:42.039858 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-48fbeff9-ec9d-4288-a05b-359f955fc39e tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:42.039858 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-48fbeff9-ec9d-4288-a05b-359f955fc39e tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:42.039858 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-48fbeff9-ec9d-4288-a05b-359f955fc39e tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:42.172201 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-48fbeff9-ec9d-4288-a05b-359f955fc39e tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661062780f5c45d180a05e402fc7bc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277fa3c89dff47b88894b781ff69fb70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:42.180678 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-48fbeff9-ec9d-4288-a05b-359f955fc39e tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/0bcc1600-ecfa-4cf0-929c-03cd036d07c3" status: 200 len: 1266 microversion: 2.1 time: 0.155365 Jul 05 13:07:42.181241 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 443/876] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:07:42 2022] GET /compute/v2.1/servers/0bcc1600-ecfa-4cf0-929c-03cd036d07c3 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:07:43.197411 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-ad1e85f2-fa46-4452-859e-73019f0ba272 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:43.198013 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-ad1e85f2-fa46-4452-859e-73019f0ba272 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: 0bcc1600-ecfa-4cf0-929c-03cd036d07c3] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:43.204510 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ad1e85f2-fa46-4452-859e-73019f0ba272 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:43.204986 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ad1e85f2-fa46-4452-859e-73019f0ba272 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:43.205811 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ad1e85f2-fa46-4452-859e-73019f0ba272 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:43.206262 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ad1e85f2-fa46-4452-859e-73019f0ba272 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:43.228063 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-8c1afe8b-65b4-4304-a7c7-853c29cfa172 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:43.228675 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-8c1afe8b-65b4-4304-a7c7-853c29cfa172 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: ec256177-0365-4a8e-af6c-56f68a6f9a54] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:43.235542 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8c1afe8b-65b4-4304-a7c7-853c29cfa172 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:43.236082 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8c1afe8b-65b4-4304-a7c7-853c29cfa172 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:43.236970 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8c1afe8b-65b4-4304-a7c7-853c29cfa172 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:43.237469 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8c1afe8b-65b4-4304-a7c7-853c29cfa172 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:43.252527 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.wsgi [None req-8c1afe8b-65b4-4304-a7c7-853c29cfa172 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] HTTP exception thrown: Instance ec256177-0365-4a8e-af6c-56f68a6f9a54 could not be found. Jul 05 13:07:43.254153 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-8c1afe8b-65b4-4304-a7c7-853c29cfa172 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Request method failure captured: Jul 05 13:07:43.254153 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: request: DELETE /compute/v2.1/servers/ec256177-0365-4a8e-af6c-56f68a6f9a54 HTTP/1.1 Jul 05 13:07:43.254153 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept: application/json Jul 05 13:07:43.254153 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept-Encoding: identity Jul 05 13:07:43.254153 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Connection: close Jul 05 13:07:43.254153 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Length: 0 Jul 05 13:07:43.254153 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Type: application/json Jul 05 13:07:43.254153 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Host: 10.222.0.36 Jul 05 13:07:43.254153 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Openstack-System-Scope: None Jul 05 13:07:43.254153 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: User-Agent: python-urllib3/1.26.9 Jul 05 13:07:43.254153 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Auth-Token: gAAAAABixDYWQWL8uJCqum4c6BlnNfbR703HW4HnpwW8iX1I1pbqlc_QGnJWLD1G-z_DKnfPJbbyyKcDC4sR005HdVrBcj6np6lEImplVRPpD09FwDfrBAC23lqXzO2ZdNTX7uxeDP3sMtbJ8KEd2t_ks3LspqcGELiRwc6BksJqjl4JxwirzAA Jul 05 13:07:43.254153 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Id: None Jul 05 13:07:43.254153 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Name: None Jul 05 13:07:43.254153 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Identity-Status: Confirmed Jul 05 13:07:43.254153 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Is-Admin-Project: True Jul 05 13:07:43.254153 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Id: default Jul 05 13:07:43.254153 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Name: Default Jul 05 13:07:43.254153 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Id: 163f0d5f47be49f493296f228d1080a5 Jul 05 13:07:43.254153 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Name: tempest-AttachVolumeNegativeTest-1554059375 Jul 05 13:07:43.254153 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Role: member,reader Jul 05 13:07:43.254153 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Roles: member,reader Jul 05 13:07:43.255708 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/163f0d5f47be49f493296f228d1080a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_163f0d5f47be49f493296f228d1080a5", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/163f0d5f47be49f493296f228d1080a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/163f0d5f47be49f493296f228d1080a5"}]}] Jul 05 13:07:43.255708 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant: tempest-AttachVolumeNegativeTest-1554059375 Jul 05 13:07:43.255708 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Id: 163f0d5f47be49f493296f228d1080a5 Jul 05 13:07:43.255708 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1554059375 Jul 05 13:07:43.255708 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User: tempest-AttachVolumeNegativeTest-1554059375-project Jul 05 13:07:43.255708 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Id: default Jul 05 13:07:43.255708 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Name: Default Jul 05 13:07:43.255708 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Id: aa97e27060b3429bbad061a256db19f1 Jul 05 13:07:43.255708 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Name: tempest-AttachVolumeNegativeTest-1554059375-project Jul 05 13:07:43.255708 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: method: > Jul 05 13:07:43.255708 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: exception: Instance ec256177-0365-4a8e-af6c-56f68a6f9a54 could not be found. Jul 05 13:07:43.255708 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: action_args: {'id': 'ec256177-0365-4a8e-af6c-56f68a6f9a54'} Jul 05 13:07:43.256570 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 13:07:43.256570 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:07:43.256570 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 13:07:43.256570 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 13:07:43.256570 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 13:07:43.256570 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 13:07:43.256570 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 13:07:43.256570 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 13:07:43.256570 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 13:07:43.256570 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 13:07:43.256570 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec256177-0365-4a8e-af6c-56f68a6f9a54 could not be found. Jul 05 13:07:43.256570 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:07:43.256570 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:07:43.256570 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:07:43.256570 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:07:43.256570 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:07:43.256570 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:07:43.256570 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 13:07:43.256570 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 13:07:43.256570 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 13:07:43.258207 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 13:07:43.258207 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 05 13:07:43.258207 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 05 13:07:43.258207 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 05 13:07:43.258207 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 05 13:07:43.258207 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 13:07:43.258207 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 13:07:43.258207 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 13:07:43.258207 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 13:07:43.258207 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec256177-0365-4a8e-af6c-56f68a6f9a54 could not be found. Jul 05 13:07:43.258207 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:07:43.258207 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:07:43.258207 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:07:43.258207 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:07:43.258207 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:07:43.258207 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:07:43.258207 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 13:07:43.258207 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 13:07:43.258207 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec256177-0365-4a8e-af6c-56f68a6f9a54 could not be found. Jul 05 13:07:43.258207 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:07:43.259815 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-8c1afe8b-65b4-4304-a7c7-853c29cfa172 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Returning 404 to user: Instance ec256177-0365-4a8e-af6c-56f68a6f9a54 could not be found. {{(pid=118387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 13:07:43.259815 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-8c1afe8b-65b4-4304-a7c7-853c29cfa172 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ec256177-0365-4a8e-af6c-56f68a6f9a54" status: 404 len: 111 microversion: 2.1 time: 0.032095 Jul 05 13:07:43.259815 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 444/877] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jul 5 13:07:43 2022] DELETE /compute/v2.1/servers/ec256177-0365-4a8e-af6c-56f68a6f9a54 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 05 13:07:43.263680 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-55a2181f-ef34-4de6-9510-93c0dff1ddf7 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:43.264294 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-55a2181f-ef34-4de6-9510-93c0dff1ddf7 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: ec256177-0365-4a8e-af6c-56f68a6f9a54] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:43.270262 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-55a2181f-ef34-4de6-9510-93c0dff1ddf7 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:43.270713 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-55a2181f-ef34-4de6-9510-93c0dff1ddf7 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:43.271479 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-55a2181f-ef34-4de6-9510-93c0dff1ddf7 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:43.271920 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-55a2181f-ef34-4de6-9510-93c0dff1ddf7 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:43.285610 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.wsgi [None req-55a2181f-ef34-4de6-9510-93c0dff1ddf7 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] HTTP exception thrown: Instance ec256177-0365-4a8e-af6c-56f68a6f9a54 could not be found. Jul 05 13:07:43.287139 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-55a2181f-ef34-4de6-9510-93c0dff1ddf7 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Request method failure captured: Jul 05 13:07:43.287139 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: request: GET /compute/v2.1/servers/ec256177-0365-4a8e-af6c-56f68a6f9a54 HTTP/1.1 Jul 05 13:07:43.287139 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept: application/json Jul 05 13:07:43.287139 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept-Encoding: identity Jul 05 13:07:43.287139 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Connection: close Jul 05 13:07:43.287139 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Length: 0 Jul 05 13:07:43.287139 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Type: application/json Jul 05 13:07:43.287139 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Host: 10.222.0.36 Jul 05 13:07:43.287139 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Openstack-System-Scope: None Jul 05 13:07:43.287139 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: User-Agent: python-urllib3/1.26.9 Jul 05 13:07:43.287139 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Auth-Token: gAAAAABixDYWQWL8uJCqum4c6BlnNfbR703HW4HnpwW8iX1I1pbqlc_QGnJWLD1G-z_DKnfPJbbyyKcDC4sR005HdVrBcj6np6lEImplVRPpD09FwDfrBAC23lqXzO2ZdNTX7uxeDP3sMtbJ8KEd2t_ks3LspqcGELiRwc6BksJqjl4JxwirzAA Jul 05 13:07:43.287139 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Id: None Jul 05 13:07:43.287139 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Name: None Jul 05 13:07:43.287139 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Identity-Status: Confirmed Jul 05 13:07:43.287139 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Is-Admin-Project: True Jul 05 13:07:43.287139 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Id: default Jul 05 13:07:43.287139 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Name: Default Jul 05 13:07:43.287139 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Id: 163f0d5f47be49f493296f228d1080a5 Jul 05 13:07:43.287139 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Name: tempest-AttachVolumeNegativeTest-1554059375 Jul 05 13:07:43.287139 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Role: member,reader Jul 05 13:07:43.287139 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Roles: member,reader Jul 05 13:07:43.288821 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/163f0d5f47be49f493296f228d1080a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_163f0d5f47be49f493296f228d1080a5", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/163f0d5f47be49f493296f228d1080a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/163f0d5f47be49f493296f228d1080a5"}]}] Jul 05 13:07:43.288821 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant: tempest-AttachVolumeNegativeTest-1554059375 Jul 05 13:07:43.288821 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Id: 163f0d5f47be49f493296f228d1080a5 Jul 05 13:07:43.288821 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1554059375 Jul 05 13:07:43.288821 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User: tempest-AttachVolumeNegativeTest-1554059375-project Jul 05 13:07:43.288821 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Id: default Jul 05 13:07:43.288821 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Name: Default Jul 05 13:07:43.288821 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Id: aa97e27060b3429bbad061a256db19f1 Jul 05 13:07:43.288821 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Name: tempest-AttachVolumeNegativeTest-1554059375-project Jul 05 13:07:43.288821 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: method: > Jul 05 13:07:43.288821 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: exception: Instance ec256177-0365-4a8e-af6c-56f68a6f9a54 could not be found. Jul 05 13:07:43.288821 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: action_args: {'id': 'ec256177-0365-4a8e-af6c-56f68a6f9a54'} Jul 05 13:07:43.290390 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 13:07:43.290390 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:07:43.290390 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 13:07:43.290390 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 13:07:43.290390 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 13:07:43.290390 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 13:07:43.290390 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 13:07:43.290390 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 13:07:43.290390 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 13:07:43.290390 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 13:07:43.290390 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec256177-0365-4a8e-af6c-56f68a6f9a54 could not be found. Jul 05 13:07:43.290390 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:07:43.290390 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:07:43.290390 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:07:43.290390 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:07:43.290390 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:07:43.290390 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:07:43.290390 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 13:07:43.290390 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 13:07:43.290390 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 13:07:43.291651 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 13:07:43.291651 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 13:07:43.291651 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 13:07:43.291651 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 13:07:43.291651 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 13:07:43.291651 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 13:07:43.291651 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 13:07:43.291651 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec256177-0365-4a8e-af6c-56f68a6f9a54 could not be found. Jul 05 13:07:43.291651 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:07:43.291651 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:07:43.291651 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:07:43.291651 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:07:43.291651 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:07:43.291651 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:07:43.291651 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 13:07:43.291651 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 13:07:43.291651 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec256177-0365-4a8e-af6c-56f68a6f9a54 could not be found. Jul 05 13:07:43.291651 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:07:43.293177 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-55a2181f-ef34-4de6-9510-93c0dff1ddf7 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Returning 404 to user: Instance ec256177-0365-4a8e-af6c-56f68a6f9a54 could not be found. {{(pid=118387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 13:07:43.293177 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-55a2181f-ef34-4de6-9510-93c0dff1ddf7 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/ec256177-0365-4a8e-af6c-56f68a6f9a54" status: 404 len: 111 microversion: 2.1 time: 0.028400 Jul 05 13:07:43.293177 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 445/878] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:07:43 2022] GET /compute/v2.1/servers/ec256177-0365-4a8e-af6c-56f68a6f9a54 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 13:07:43.297095 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-e1135838-7056-4d91-a2d9-047b71b2f792 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:43.297593 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-e1135838-7056-4d91-a2d9-047b71b2f792 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: fce1b2d5-4167-4f64-9ea2-794a86830bd2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:43.303492 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e1135838-7056-4d91-a2d9-047b71b2f792 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:43.303946 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e1135838-7056-4d91-a2d9-047b71b2f792 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:43.304772 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e1135838-7056-4d91-a2d9-047b71b2f792 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:43.305212 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e1135838-7056-4d91-a2d9-047b71b2f792 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:43.318345 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.wsgi [None req-e1135838-7056-4d91-a2d9-047b71b2f792 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] HTTP exception thrown: Instance fce1b2d5-4167-4f64-9ea2-794a86830bd2 could not be found. Jul 05 13:07:43.319901 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-e1135838-7056-4d91-a2d9-047b71b2f792 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Request method failure captured: Jul 05 13:07:43.319901 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: request: DELETE /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2 HTTP/1.1 Jul 05 13:07:43.319901 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept: application/json Jul 05 13:07:43.319901 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept-Encoding: identity Jul 05 13:07:43.319901 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Connection: close Jul 05 13:07:43.319901 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Length: 0 Jul 05 13:07:43.319901 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Type: application/json Jul 05 13:07:43.319901 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Host: 10.222.0.36 Jul 05 13:07:43.319901 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Openstack-System-Scope: None Jul 05 13:07:43.319901 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: User-Agent: python-urllib3/1.26.9 Jul 05 13:07:43.319901 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Auth-Token: gAAAAABixDYWQWL8uJCqum4c6BlnNfbR703HW4HnpwW8iX1I1pbqlc_QGnJWLD1G-z_DKnfPJbbyyKcDC4sR005HdVrBcj6np6lEImplVRPpD09FwDfrBAC23lqXzO2ZdNTX7uxeDP3sMtbJ8KEd2t_ks3LspqcGELiRwc6BksJqjl4JxwirzAA Jul 05 13:07:43.319901 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Id: None Jul 05 13:07:43.319901 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Name: None Jul 05 13:07:43.319901 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Identity-Status: Confirmed Jul 05 13:07:43.319901 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Is-Admin-Project: True Jul 05 13:07:43.319901 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Id: default Jul 05 13:07:43.319901 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Name: Default Jul 05 13:07:43.319901 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Id: 163f0d5f47be49f493296f228d1080a5 Jul 05 13:07:43.319901 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Name: tempest-AttachVolumeNegativeTest-1554059375 Jul 05 13:07:43.319901 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Role: member,reader Jul 05 13:07:43.319901 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Roles: member,reader Jul 05 13:07:43.322017 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/163f0d5f47be49f493296f228d1080a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_163f0d5f47be49f493296f228d1080a5", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/163f0d5f47be49f493296f228d1080a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/163f0d5f47be49f493296f228d1080a5"}]}] Jul 05 13:07:43.322017 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant: tempest-AttachVolumeNegativeTest-1554059375 Jul 05 13:07:43.322017 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Id: 163f0d5f47be49f493296f228d1080a5 Jul 05 13:07:43.322017 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1554059375 Jul 05 13:07:43.322017 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User: tempest-AttachVolumeNegativeTest-1554059375-project Jul 05 13:07:43.322017 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Id: default Jul 05 13:07:43.322017 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Name: Default Jul 05 13:07:43.322017 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Id: aa97e27060b3429bbad061a256db19f1 Jul 05 13:07:43.322017 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Name: tempest-AttachVolumeNegativeTest-1554059375-project Jul 05 13:07:43.322017 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: method: > Jul 05 13:07:43.322017 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: exception: Instance fce1b2d5-4167-4f64-9ea2-794a86830bd2 could not be found. Jul 05 13:07:43.322017 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: action_args: {'id': 'fce1b2d5-4167-4f64-9ea2-794a86830bd2'} Jul 05 13:07:43.322894 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 13:07:43.322894 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:07:43.322894 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 13:07:43.322894 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 13:07:43.322894 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 13:07:43.322894 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 13:07:43.322894 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 13:07:43.322894 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 13:07:43.322894 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 13:07:43.322894 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 13:07:43.322894 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fce1b2d5-4167-4f64-9ea2-794a86830bd2 could not be found. Jul 05 13:07:43.322894 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:07:43.322894 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:07:43.322894 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:07:43.322894 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:07:43.322894 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:07:43.322894 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:07:43.322894 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 13:07:43.322894 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 13:07:43.322894 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 13:07:43.324341 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 13:07:43.324341 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 05 13:07:43.324341 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 05 13:07:43.324341 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 05 13:07:43.324341 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 05 13:07:43.324341 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 13:07:43.324341 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 13:07:43.324341 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 13:07:43.324341 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 13:07:43.324341 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fce1b2d5-4167-4f64-9ea2-794a86830bd2 could not be found. Jul 05 13:07:43.324341 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:07:43.324341 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:07:43.324341 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:07:43.324341 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:07:43.324341 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:07:43.324341 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:07:43.324341 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 13:07:43.324341 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 13:07:43.324341 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fce1b2d5-4167-4f64-9ea2-794a86830bd2 could not be found. Jul 05 13:07:43.324341 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:07:43.325855 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-e1135838-7056-4d91-a2d9-047b71b2f792 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Returning 404 to user: Instance fce1b2d5-4167-4f64-9ea2-794a86830bd2 could not be found. {{(pid=118387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 13:07:43.325855 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-e1135838-7056-4d91-a2d9-047b71b2f792 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "DELETE /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2" status: 404 len: 111 microversion: 2.1 time: 0.028288 Jul 05 13:07:43.325855 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 446/879] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jul 5 13:07:43 2022] DELETE /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 05 13:07:43.333791 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-e077b5d3-fd2f-4286-9885-04d6d41384ac tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:43.334405 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-e077b5d3-fd2f-4286-9885-04d6d41384ac tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: fce1b2d5-4167-4f64-9ea2-794a86830bd2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:43.340704 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e077b5d3-fd2f-4286-9885-04d6d41384ac tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:43.341159 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e077b5d3-fd2f-4286-9885-04d6d41384ac tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:43.341926 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e077b5d3-fd2f-4286-9885-04d6d41384ac tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:43.342363 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e077b5d3-fd2f-4286-9885-04d6d41384ac tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:43.347249 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-ad1e85f2-fa46-4452-859e-73019f0ba272 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661062780f5c45d180a05e402fc7bc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277fa3c89dff47b88894b781ff69fb70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:43.354572 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-ad1e85f2-fa46-4452-859e-73019f0ba272 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/0bcc1600-ecfa-4cf0-929c-03cd036d07c3" status: 200 len: 1266 microversion: 2.1 time: 0.161004 Jul 05 13:07:43.355135 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 434/880] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:07:43 2022] GET /compute/v2.1/servers/0bcc1600-ecfa-4cf0-929c-03cd036d07c3 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:07:43.355776 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.wsgi [None req-e077b5d3-fd2f-4286-9885-04d6d41384ac tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] HTTP exception thrown: Instance fce1b2d5-4167-4f64-9ea2-794a86830bd2 could not be found. Jul 05 13:07:43.357438 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-e077b5d3-fd2f-4286-9885-04d6d41384ac tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Request method failure captured: Jul 05 13:07:43.357438 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: request: GET /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2 HTTP/1.1 Jul 05 13:07:43.357438 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept: application/json Jul 05 13:07:43.357438 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept-Encoding: identity Jul 05 13:07:43.357438 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Connection: close Jul 05 13:07:43.357438 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Length: 0 Jul 05 13:07:43.357438 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Type: application/json Jul 05 13:07:43.357438 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Host: 10.222.0.36 Jul 05 13:07:43.357438 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Openstack-System-Scope: None Jul 05 13:07:43.357438 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: User-Agent: python-urllib3/1.26.9 Jul 05 13:07:43.357438 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Auth-Token: gAAAAABixDYWQWL8uJCqum4c6BlnNfbR703HW4HnpwW8iX1I1pbqlc_QGnJWLD1G-z_DKnfPJbbyyKcDC4sR005HdVrBcj6np6lEImplVRPpD09FwDfrBAC23lqXzO2ZdNTX7uxeDP3sMtbJ8KEd2t_ks3LspqcGELiRwc6BksJqjl4JxwirzAA Jul 05 13:07:43.357438 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Id: None Jul 05 13:07:43.357438 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Name: None Jul 05 13:07:43.357438 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Identity-Status: Confirmed Jul 05 13:07:43.357438 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Is-Admin-Project: True Jul 05 13:07:43.357438 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Id: default Jul 05 13:07:43.357438 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Name: Default Jul 05 13:07:43.357438 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Id: 163f0d5f47be49f493296f228d1080a5 Jul 05 13:07:43.357438 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Name: tempest-AttachVolumeNegativeTest-1554059375 Jul 05 13:07:43.357438 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Role: member,reader Jul 05 13:07:43.357438 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Roles: member,reader Jul 05 13:07:43.358993 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/163f0d5f47be49f493296f228d1080a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_163f0d5f47be49f493296f228d1080a5", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/163f0d5f47be49f493296f228d1080a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/163f0d5f47be49f493296f228d1080a5"}]}] Jul 05 13:07:43.358993 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant: tempest-AttachVolumeNegativeTest-1554059375 Jul 05 13:07:43.358993 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Id: 163f0d5f47be49f493296f228d1080a5 Jul 05 13:07:43.358993 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1554059375 Jul 05 13:07:43.358993 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User: tempest-AttachVolumeNegativeTest-1554059375-project Jul 05 13:07:43.358993 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Id: default Jul 05 13:07:43.358993 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Name: Default Jul 05 13:07:43.358993 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Id: aa97e27060b3429bbad061a256db19f1 Jul 05 13:07:43.358993 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Name: tempest-AttachVolumeNegativeTest-1554059375-project Jul 05 13:07:43.358993 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: method: > Jul 05 13:07:43.358993 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: exception: Instance fce1b2d5-4167-4f64-9ea2-794a86830bd2 could not be found. Jul 05 13:07:43.358993 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: action_args: {'id': 'fce1b2d5-4167-4f64-9ea2-794a86830bd2'} Jul 05 13:07:43.359843 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 13:07:43.359843 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:07:43.359843 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 13:07:43.359843 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 13:07:43.359843 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 13:07:43.359843 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 13:07:43.359843 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 13:07:43.359843 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 13:07:43.359843 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 13:07:43.359843 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 13:07:43.359843 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fce1b2d5-4167-4f64-9ea2-794a86830bd2 could not be found. Jul 05 13:07:43.359843 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:07:43.359843 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:07:43.359843 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:07:43.359843 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:07:43.359843 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:07:43.359843 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:07:43.359843 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 13:07:43.359843 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 13:07:43.359843 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 13:07:43.361287 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 13:07:43.361287 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 13:07:43.361287 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 13:07:43.361287 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 13:07:43.361287 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 13:07:43.361287 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 13:07:43.361287 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 13:07:43.361287 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fce1b2d5-4167-4f64-9ea2-794a86830bd2 could not be found. Jul 05 13:07:43.361287 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:07:43.361287 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:07:43.361287 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:07:43.361287 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:07:43.361287 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:07:43.361287 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:07:43.361287 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 13:07:43.361287 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 13:07:43.361287 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fce1b2d5-4167-4f64-9ea2-794a86830bd2 could not be found. Jul 05 13:07:43.361287 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:07:43.362508 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-e077b5d3-fd2f-4286-9885-04d6d41384ac tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Returning 404 to user: Instance fce1b2d5-4167-4f64-9ea2-794a86830bd2 could not be found. {{(pid=118387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 13:07:43.362508 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-e077b5d3-fd2f-4286-9885-04d6d41384ac tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2" status: 404 len: 111 microversion: 2.1 time: 0.028614 Jul 05 13:07:43.362508 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 447/881] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:07:43 2022] GET /compute/v2.1/servers/fce1b2d5-4167-4f64-9ea2-794a86830bd2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 05 13:07:44.371407 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-0c4d65ea-2f87-4d8c-b2dc-52dbb3da879c tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:44.371937 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-0c4d65ea-2f87-4d8c-b2dc-52dbb3da879c tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: 0bcc1600-ecfa-4cf0-929c-03cd036d07c3] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:44.378489 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-0c4d65ea-2f87-4d8c-b2dc-52dbb3da879c tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:44.378930 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-0c4d65ea-2f87-4d8c-b2dc-52dbb3da879c tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:44.379681 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-0c4d65ea-2f87-4d8c-b2dc-52dbb3da879c tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:44.380108 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-0c4d65ea-2f87-4d8c-b2dc-52dbb3da879c tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:44.510075 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-0c4d65ea-2f87-4d8c-b2dc-52dbb3da879c tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661062780f5c45d180a05e402fc7bc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277fa3c89dff47b88894b781ff69fb70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:44.517608 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-0c4d65ea-2f87-4d8c-b2dc-52dbb3da879c tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/0bcc1600-ecfa-4cf0-929c-03cd036d07c3" status: 200 len: 1266 microversion: 2.1 time: 0.150052 Jul 05 13:07:44.518219 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 435/882] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:07:44 2022] GET /compute/v2.1/servers/0bcc1600-ecfa-4cf0-929c-03cd036d07c3 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:07:44.687475 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-e5755dcd-a4f2-42f8-9e4c-5ca26edae573 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:44.687999 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-e5755dcd-a4f2-42f8-9e4c-5ca26edae573 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 0f8f2957-1273-413b-ab2b-32da8868f70d] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:44.694483 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e5755dcd-a4f2-42f8-9e4c-5ca26edae573 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:44.694935 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e5755dcd-a4f2-42f8-9e4c-5ca26edae573 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:44.696454 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e5755dcd-a4f2-42f8-9e4c-5ca26edae573 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:44.696919 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e5755dcd-a4f2-42f8-9e4c-5ca26edae573 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:44.711410 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.wsgi [None req-e5755dcd-a4f2-42f8-9e4c-5ca26edae573 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] HTTP exception thrown: Instance 0f8f2957-1273-413b-ab2b-32da8868f70d could not be found. Jul 05 13:07:44.713033 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-e5755dcd-a4f2-42f8-9e4c-5ca26edae573 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Request method failure captured: Jul 05 13:07:44.713033 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: request: DELETE /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d HTTP/1.1 Jul 05 13:07:44.713033 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept: application/json Jul 05 13:07:44.713033 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept-Encoding: identity Jul 05 13:07:44.713033 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Connection: close Jul 05 13:07:44.713033 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Length: 0 Jul 05 13:07:44.713033 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Type: application/json Jul 05 13:07:44.713033 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Host: 10.222.0.36 Jul 05 13:07:44.713033 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Openstack-System-Scope: None Jul 05 13:07:44.713033 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: User-Agent: python-urllib3/1.26.9 Jul 05 13:07:44.713033 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Auth-Token: gAAAAABixDYWQWL8uJCqum4c6BlnNfbR703HW4HnpwW8iX1I1pbqlc_QGnJWLD1G-z_DKnfPJbbyyKcDC4sR005HdVrBcj6np6lEImplVRPpD09FwDfrBAC23lqXzO2ZdNTX7uxeDP3sMtbJ8KEd2t_ks3LspqcGELiRwc6BksJqjl4JxwirzAA Jul 05 13:07:44.713033 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Id: None Jul 05 13:07:44.713033 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Name: None Jul 05 13:07:44.713033 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Identity-Status: Confirmed Jul 05 13:07:44.713033 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Is-Admin-Project: True Jul 05 13:07:44.713033 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Id: default Jul 05 13:07:44.713033 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Name: Default Jul 05 13:07:44.713033 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Id: 163f0d5f47be49f493296f228d1080a5 Jul 05 13:07:44.713033 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Name: tempest-AttachVolumeNegativeTest-1554059375 Jul 05 13:07:44.713033 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Role: member,reader Jul 05 13:07:44.713033 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Roles: member,reader Jul 05 13:07:44.714620 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/163f0d5f47be49f493296f228d1080a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_163f0d5f47be49f493296f228d1080a5", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/163f0d5f47be49f493296f228d1080a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/163f0d5f47be49f493296f228d1080a5"}]}] Jul 05 13:07:44.714620 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant: tempest-AttachVolumeNegativeTest-1554059375 Jul 05 13:07:44.714620 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Id: 163f0d5f47be49f493296f228d1080a5 Jul 05 13:07:44.714620 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1554059375 Jul 05 13:07:44.714620 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User: tempest-AttachVolumeNegativeTest-1554059375-project Jul 05 13:07:44.714620 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Id: default Jul 05 13:07:44.714620 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Name: Default Jul 05 13:07:44.714620 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Id: aa97e27060b3429bbad061a256db19f1 Jul 05 13:07:44.714620 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Name: tempest-AttachVolumeNegativeTest-1554059375-project Jul 05 13:07:44.714620 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: method: > Jul 05 13:07:44.714620 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: exception: Instance 0f8f2957-1273-413b-ab2b-32da8868f70d could not be found. Jul 05 13:07:44.714620 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: action_args: {'id': '0f8f2957-1273-413b-ab2b-32da8868f70d'} Jul 05 13:07:44.715532 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 13:07:44.715532 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:07:44.715532 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 13:07:44.715532 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 13:07:44.715532 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 13:07:44.715532 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 13:07:44.715532 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 13:07:44.715532 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 13:07:44.715532 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 13:07:44.715532 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 13:07:44.715532 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f8f2957-1273-413b-ab2b-32da8868f70d could not be found. Jul 05 13:07:44.715532 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:07:44.715532 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:07:44.715532 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:07:44.715532 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:07:44.715532 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:07:44.715532 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:07:44.715532 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 13:07:44.715532 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 13:07:44.715532 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 13:07:44.717101 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 13:07:44.717101 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 05 13:07:44.717101 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 05 13:07:44.717101 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 05 13:07:44.717101 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 05 13:07:44.717101 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 13:07:44.717101 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 13:07:44.717101 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 13:07:44.717101 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 13:07:44.717101 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f8f2957-1273-413b-ab2b-32da8868f70d could not be found. Jul 05 13:07:44.717101 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:07:44.717101 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:07:44.717101 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:07:44.717101 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:07:44.717101 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:07:44.717101 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:07:44.717101 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 13:07:44.717101 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 13:07:44.717101 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f8f2957-1273-413b-ab2b-32da8868f70d could not be found. Jul 05 13:07:44.717101 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:07:44.719005 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-e5755dcd-a4f2-42f8-9e4c-5ca26edae573 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Returning 404 to user: Instance 0f8f2957-1273-413b-ab2b-32da8868f70d could not be found. {{(pid=118387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 13:07:44.719005 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-e5755dcd-a4f2-42f8-9e4c-5ca26edae573 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "DELETE /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d" status: 404 len: 111 microversion: 2.1 time: 0.030895 Jul 05 13:07:44.719005 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 448/883] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jul 5 13:07:44 2022] DELETE /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 13:07:44.723013 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-a90d3796-8bbe-446a-9b7d-dfefc9199035 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:44.723626 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-a90d3796-8bbe-446a-9b7d-dfefc9199035 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] [instance: 0f8f2957-1273-413b-ab2b-32da8868f70d] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:44.729569 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a90d3796-8bbe-446a-9b7d-dfefc9199035 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:44.730164 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a90d3796-8bbe-446a-9b7d-dfefc9199035 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:44.731041 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a90d3796-8bbe-446a-9b7d-dfefc9199035 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:44.731478 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a90d3796-8bbe-446a-9b7d-dfefc9199035 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:44.745080 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.wsgi [None req-a90d3796-8bbe-446a-9b7d-dfefc9199035 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] HTTP exception thrown: Instance 0f8f2957-1273-413b-ab2b-32da8868f70d could not be found. Jul 05 13:07:44.746590 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-a90d3796-8bbe-446a-9b7d-dfefc9199035 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Request method failure captured: Jul 05 13:07:44.746590 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: request: GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d HTTP/1.1 Jul 05 13:07:44.746590 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Accept: application/json Jul 05 13:07:44.746590 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Accept-Encoding: identity Jul 05 13:07:44.746590 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Connection: close Jul 05 13:07:44.746590 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Content-Length: 0 Jul 05 13:07:44.746590 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Content-Type: application/json Jul 05 13:07:44.746590 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Host: 10.222.0.36 Jul 05 13:07:44.746590 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Openstack-System-Scope: None Jul 05 13:07:44.746590 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: User-Agent: python-urllib3/1.26.9 Jul 05 13:07:44.746590 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Auth-Token: gAAAAABixDYWQWL8uJCqum4c6BlnNfbR703HW4HnpwW8iX1I1pbqlc_QGnJWLD1G-z_DKnfPJbbyyKcDC4sR005HdVrBcj6np6lEImplVRPpD09FwDfrBAC23lqXzO2ZdNTX7uxeDP3sMtbJ8KEd2t_ks3LspqcGELiRwc6BksJqjl4JxwirzAA Jul 05 13:07:44.746590 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Domain-Id: None Jul 05 13:07:44.746590 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Domain-Name: None Jul 05 13:07:44.746590 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Identity-Status: Confirmed Jul 05 13:07:44.746590 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Is-Admin-Project: True Jul 05 13:07:44.746590 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Domain-Id: default Jul 05 13:07:44.746590 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Domain-Name: Default Jul 05 13:07:44.746590 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Id: 163f0d5f47be49f493296f228d1080a5 Jul 05 13:07:44.746590 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Name: tempest-AttachVolumeNegativeTest-1554059375 Jul 05 13:07:44.746590 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Role: member,reader Jul 05 13:07:44.746590 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Roles: member,reader Jul 05 13:07:44.748253 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/163f0d5f47be49f493296f228d1080a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_163f0d5f47be49f493296f228d1080a5", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/163f0d5f47be49f493296f228d1080a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/163f0d5f47be49f493296f228d1080a5"}]}] Jul 05 13:07:44.748253 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Tenant: tempest-AttachVolumeNegativeTest-1554059375 Jul 05 13:07:44.748253 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Tenant-Id: 163f0d5f47be49f493296f228d1080a5 Jul 05 13:07:44.748253 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1554059375 Jul 05 13:07:44.748253 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User: tempest-AttachVolumeNegativeTest-1554059375-project Jul 05 13:07:44.748253 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Domain-Id: default Jul 05 13:07:44.748253 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Domain-Name: Default Jul 05 13:07:44.748253 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Id: aa97e27060b3429bbad061a256db19f1 Jul 05 13:07:44.748253 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Name: tempest-AttachVolumeNegativeTest-1554059375-project Jul 05 13:07:44.748253 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: method: > Jul 05 13:07:44.748253 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: exception: Instance 0f8f2957-1273-413b-ab2b-32da8868f70d could not be found. Jul 05 13:07:44.748253 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: action_args: {'id': '0f8f2957-1273-413b-ab2b-32da8868f70d'} Jul 05 13:07:44.753387 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 13:07:44.753387 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:07:44.753387 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 13:07:44.753387 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 13:07:44.753387 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 13:07:44.753387 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 13:07:44.753387 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 13:07:44.753387 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 13:07:44.753387 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 13:07:44.753387 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 13:07:44.753387 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f8f2957-1273-413b-ab2b-32da8868f70d could not be found. Jul 05 13:07:44.753387 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:07:44.753387 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:07:44.753387 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:07:44.753387 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:07:44.753387 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:07:44.753387 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:07:44.753387 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 13:07:44.753387 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 13:07:44.753387 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 13:07:44.755386 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 13:07:44.755386 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 13:07:44.755386 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 13:07:44.755386 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 13:07:44.755386 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 13:07:44.755386 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 13:07:44.755386 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 13:07:44.755386 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f8f2957-1273-413b-ab2b-32da8868f70d could not be found. Jul 05 13:07:44.755386 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:07:44.755386 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:07:44.755386 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:07:44.755386 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:07:44.755386 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:07:44.755386 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:07:44.755386 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 13:07:44.755386 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 13:07:44.755386 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f8f2957-1273-413b-ab2b-32da8868f70d could not be found. Jul 05 13:07:44.755386 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:07:44.756736 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-a90d3796-8bbe-446a-9b7d-dfefc9199035 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] Returning 404 to user: Instance 0f8f2957-1273-413b-ab2b-32da8868f70d could not be found. {{(pid=118386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 13:07:44.756736 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-a90d3796-8bbe-446a-9b7d-dfefc9199035 tempest-AttachVolumeNegativeTest-1554059375 tempest-AttachVolumeNegativeTest-1554059375-project] 10.222.0.36 "GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d" status: 404 len: 111 microversion: 2.1 time: 0.028769 Jul 05 13:07:44.756736 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 436/884] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:07:44 2022] GET /compute/v2.1/servers/0f8f2957-1273-413b-ab2b-32da8868f70d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 13:07:45.534195 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-23ea6d49-6f67-4014-9d17-4805c3a0a358 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:45.534836 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-23ea6d49-6f67-4014-9d17-4805c3a0a358 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: 0bcc1600-ecfa-4cf0-929c-03cd036d07c3] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:45.541440 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-23ea6d49-6f67-4014-9d17-4805c3a0a358 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:45.541893 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-23ea6d49-6f67-4014-9d17-4805c3a0a358 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:45.542658 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-23ea6d49-6f67-4014-9d17-4805c3a0a358 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:45.543092 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-23ea6d49-6f67-4014-9d17-4805c3a0a358 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:45.677500 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-23ea6d49-6f67-4014-9d17-4805c3a0a358 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661062780f5c45d180a05e402fc7bc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277fa3c89dff47b88894b781ff69fb70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:45.684921 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-23ea6d49-6f67-4014-9d17-4805c3a0a358 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/0bcc1600-ecfa-4cf0-929c-03cd036d07c3" status: 200 len: 1266 microversion: 2.1 time: 0.154634 Jul 05 13:07:45.685475 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 449/885] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:07:45 2022] GET /compute/v2.1/servers/0bcc1600-ecfa-4cf0-929c-03cd036d07c3 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:07:46.701604 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-7c4d3390-3a61-4d27-9eb8-d90c36bb0435 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:46.702424 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-7c4d3390-3a61-4d27-9eb8-d90c36bb0435 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: 0bcc1600-ecfa-4cf0-929c-03cd036d07c3] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:46.708804 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-7c4d3390-3a61-4d27-9eb8-d90c36bb0435 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:46.709256 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-7c4d3390-3a61-4d27-9eb8-d90c36bb0435 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:46.710020 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-7c4d3390-3a61-4d27-9eb8-d90c36bb0435 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:46.710452 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-7c4d3390-3a61-4d27-9eb8-d90c36bb0435 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:46.847382 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-7c4d3390-3a61-4d27-9eb8-d90c36bb0435 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661062780f5c45d180a05e402fc7bc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277fa3c89dff47b88894b781ff69fb70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:46.859993 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-7c4d3390-3a61-4d27-9eb8-d90c36bb0435 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/0bcc1600-ecfa-4cf0-929c-03cd036d07c3" status: 200 len: 1266 microversion: 2.1 time: 0.162181 Jul 05 13:07:46.860666 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 437/886] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:07:46 2022] GET /compute/v2.1/servers/0bcc1600-ecfa-4cf0-929c-03cd036d07c3 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:07:47.877167 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-9ff425a7-eb29-4622-a9b2-b22ff866cb37 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:47.877768 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-9ff425a7-eb29-4622-a9b2-b22ff866cb37 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: 0bcc1600-ecfa-4cf0-929c-03cd036d07c3] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:47.884265 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9ff425a7-eb29-4622-a9b2-b22ff866cb37 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:47.884754 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9ff425a7-eb29-4622-a9b2-b22ff866cb37 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:47.885526 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9ff425a7-eb29-4622-a9b2-b22ff866cb37 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:47.885968 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9ff425a7-eb29-4622-a9b2-b22ff866cb37 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:48.033159 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-9ff425a7-eb29-4622-a9b2-b22ff866cb37 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661062780f5c45d180a05e402fc7bc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277fa3c89dff47b88894b781ff69fb70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:48.041867 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-9ff425a7-eb29-4622-a9b2-b22ff866cb37 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/0bcc1600-ecfa-4cf0-929c-03cd036d07c3" status: 200 len: 1266 microversion: 2.1 time: 0.168571 Jul 05 13:07:48.042431 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 450/887] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:07:47 2022] GET /compute/v2.1/servers/0bcc1600-ecfa-4cf0-929c-03cd036d07c3 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:07:48.051753 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [req-639b4b71-7fde-452f-9450-37a66403a68e req-c0d186cb-ed40-43fe-937d-05788eb95b7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bcc1600-ecfa-4cf0-929c-03cd036d07c3", "name": "network-vif-plugged", "status": "completed", "tag": "d010e1f8-d442-4111-a65d-8c9e9e080c9f"}]} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:07:48.061090 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-639b4b71-7fde-452f-9450-37a66403a68e req-c0d186cb-ed40-43fe-937d-05788eb95b7c service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:48.061538 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-639b4b71-7fde-452f-9450-37a66403a68e req-c0d186cb-ed40-43fe-937d-05788eb95b7c service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:48.072857 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.compute.server_external_events [req-639b4b71-7fde-452f-9450-37a66403a68e req-c0d186cb-ed40-43fe-937d-05788eb95b7c service nova] Creating event network-vif-plugged:d010e1f8-d442-4111-a65d-8c9e9e080c9f for instance 0bcc1600-ecfa-4cf0-929c-03cd036d07c3 on hv-cinder-79760 Jul 05 13:07:48.077772 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [req-639b4b71-7fde-452f-9450-37a66403a68e req-c0d186cb-ed40-43fe-937d-05788eb95b7c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030030 Jul 05 13:07:48.078348 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 438/888] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 13:07:49.059338 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-9811a454-b88d-4786-a362-539d0f8538e6 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:49.059982 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-9811a454-b88d-4786-a362-539d0f8538e6 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: 0bcc1600-ecfa-4cf0-929c-03cd036d07c3] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:49.067132 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9811a454-b88d-4786-a362-539d0f8538e6 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:49.067132 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9811a454-b88d-4786-a362-539d0f8538e6 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:49.067780 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9811a454-b88d-4786-a362-539d0f8538e6 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:49.068213 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9811a454-b88d-4786-a362-539d0f8538e6 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:49.197545 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-9811a454-b88d-4786-a362-539d0f8538e6 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661062780f5c45d180a05e402fc7bc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277fa3c89dff47b88894b781ff69fb70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:49.204911 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-9811a454-b88d-4786-a362-539d0f8538e6 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/0bcc1600-ecfa-4cf0-929c-03cd036d07c3" status: 200 len: 1266 microversion: 2.1 time: 0.149450 Jul 05 13:07:49.205464 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 451/889] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:07:49 2022] GET /compute/v2.1/servers/0bcc1600-ecfa-4cf0-929c-03cd036d07c3 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:07:50.222187 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-ae4ceea2-2e03-40d5-8cef-ff80fa80b725 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:50.222975 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-ae4ceea2-2e03-40d5-8cef-ff80fa80b725 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: 0bcc1600-ecfa-4cf0-929c-03cd036d07c3] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:50.229304 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ae4ceea2-2e03-40d5-8cef-ff80fa80b725 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:50.229751 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ae4ceea2-2e03-40d5-8cef-ff80fa80b725 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:50.230777 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ae4ceea2-2e03-40d5-8cef-ff80fa80b725 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:50.231425 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ae4ceea2-2e03-40d5-8cef-ff80fa80b725 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:50.394217 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-ae4ceea2-2e03-40d5-8cef-ff80fa80b725 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661062780f5c45d180a05e402fc7bc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277fa3c89dff47b88894b781ff69fb70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:50.402327 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-ae4ceea2-2e03-40d5-8cef-ff80fa80b725 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/0bcc1600-ecfa-4cf0-929c-03cd036d07c3" status: 200 len: 1266 microversion: 2.1 time: 0.184834 Jul 05 13:07:50.402890 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 439/890] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:07:50 2022] GET /compute/v2.1/servers/0bcc1600-ecfa-4cf0-929c-03cd036d07c3 => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:07:51.117143 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-69a015c1-22cc-4bd1-a30b-4353dbca9076 tempest-VolumesNegativeTest-339578529 tempest-VolumesNegativeTest-339578529-project] Action: 'create', calling method: .version_select at 0x7f70de6eb9d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2049915535", "metadata": {"Type": "work"}}} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:07:51.138495 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-69a015c1-22cc-4bd1-a30b-4353dbca9076 tempest-VolumesNegativeTest-339578529 tempest-VolumesNegativeTest-339578529-project] Request method failure captured: Jul 05 13:07:51.138495 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 05 13:07:51.138495 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept: application/json Jul 05 13:07:51.138495 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept-Encoding: identity Jul 05 13:07:51.138495 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Connection: close Jul 05 13:07:51.138495 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Length: 122 Jul 05 13:07:51.138495 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Type: application/json Jul 05 13:07:51.138495 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Host: 10.222.0.36 Jul 05 13:07:51.138495 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Openstack-System-Scope: None Jul 05 13:07:51.138495 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: User-Agent: python-urllib3/1.26.9 Jul 05 13:07:51.138495 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Auth-Token: gAAAAABixDemvGTS2azHCdp0cMUNYXxAY62x9uPXR5ImWDJ2EYV13Iblyl1wT8Qitlol2vzKY2VAuEDHiMiOwfh4yw8V4x_bcNQW6iShQ7pDGFibqdQ5i_wbEroGiGkS2qpesPgXuQvUJIvfH4gdYURuM32hpro5ldcRb32d9j3RanFSjkQhcd0 Jul 05 13:07:51.138495 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Id: None Jul 05 13:07:51.138495 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Name: None Jul 05 13:07:51.138495 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Identity-Status: Confirmed Jul 05 13:07:51.138495 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Is-Admin-Project: True Jul 05 13:07:51.138495 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Id: default Jul 05 13:07:51.138495 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Name: Default Jul 05 13:07:51.138495 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Id: 21152f748d68413ca8f807e5111ab8a3 Jul 05 13:07:51.138495 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Name: tempest-VolumesNegativeTest-339578529 Jul 05 13:07:51.138495 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Role: member,reader Jul 05 13:07:51.138495 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Roles: member,reader Jul 05 13:07:51.140244 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/21152f748d68413ca8f807e5111ab8a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_21152f748d68413ca8f807e5111ab8a3", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/21152f748d68413ca8f807e5111ab8a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/21152f748d68413ca8f807e5111ab8a3"}]}] Jul 05 13:07:51.140244 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant: tempest-VolumesNegativeTest-339578529 Jul 05 13:07:51.140244 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Id: 21152f748d68413ca8f807e5111ab8a3 Jul 05 13:07:51.140244 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Name: tempest-VolumesNegativeTest-339578529 Jul 05 13:07:51.140244 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User: tempest-VolumesNegativeTest-339578529-project Jul 05 13:07:51.140244 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Id: default Jul 05 13:07:51.140244 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Name: Default Jul 05 13:07:51.140244 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Id: a0c6d56f4960497b85e1e171db8a3065 Jul 05 13:07:51.140244 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Name: tempest-VolumesNegativeTest-339578529-project Jul 05 13:07:51.140244 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Jul 05 13:07:51.140244 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2049915535", "metadata": {"Type": "work"}}} Jul 05 13:07:51.140244 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: method: Jul 05 13:07:51.140244 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 05 13:07:51.145608 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-2049915535', 'metadata': {'Type': 'work'}}}} Jul 05 13:07:51.145608 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 13:07:51.145608 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:07:51.145608 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 05 13:07:51.145608 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 05 13:07:51.145608 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 05 13:07:51.145608 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise error Jul 05 13:07:51.145608 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 05 13:07:51.145608 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:07:51.145608 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 05 13:07:51.145608 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 05 13:07:51.145608 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:07:51.145608 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 05 13:07:51.145608 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi '#$%' Jul 05 13:07:51.145608 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:07:51.145608 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:07:51.145608 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:07:51.145608 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:07:51.145608 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:07:51.145608 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:07:51.145608 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 13:07:51.145608 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 13:07:51.147349 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 05 13:07:51.147349 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 05 13:07:51.147349 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 13:07:51.147349 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 13:07:51.147349 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 05 13:07:51.147349 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 05 13:07:51.147349 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 05 13:07:51.147349 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 05 13:07:51.147349 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 05 13:07:51.147349 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 05 13:07:51.147349 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 05 13:07:51.147349 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:07:51.147349 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:07:51.147349 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:07:51.147349 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:07:51.147349 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:07:51.147349 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:07:51.147349 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 05 13:07:51.147349 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 05 13:07:51.148868 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 05 13:07:51.148868 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:07:51.148868 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-69a015c1-22cc-4bd1-a30b-4353dbca9076 tempest-VolumesNegativeTest-339578529 tempest-VolumesNegativeTest-339578529-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 13:07:51.148868 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-69a015c1-22cc-4bd1-a30b-4353dbca9076 tempest-VolumesNegativeTest-339578529 tempest-VolumesNegativeTest-339578529-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.133004 Jul 05 13:07:51.148868 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 452/891] 10.222.0.36 () {60 vars in 1155 bytes} [Tue Jul 5 13:07:51 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 134 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 05 13:07:51.149538 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-690ba452-2268-49fa-a5c6-c881be6ebd2d tempest-VolumesNegativeTest-339578529 tempest-VolumesNegativeTest-339578529-project] Action: 'create', calling method: .version_select at 0x7f70de646940>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2039973629", "metadata": {"Type": "work"}}} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:07:51.152895 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-690ba452-2268-49fa-a5c6-c881be6ebd2d tempest-VolumesNegativeTest-339578529 tempest-VolumesNegativeTest-339578529-project] Request method failure captured: Jul 05 13:07:51.152895 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 05 13:07:51.152895 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Accept: application/json Jul 05 13:07:51.152895 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Accept-Encoding: identity Jul 05 13:07:51.152895 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Connection: close Jul 05 13:07:51.152895 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Content-Length: 120 Jul 05 13:07:51.152895 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Content-Type: application/json Jul 05 13:07:51.152895 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Host: 10.222.0.36 Jul 05 13:07:51.152895 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Openstack-System-Scope: None Jul 05 13:07:51.152895 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: User-Agent: python-urllib3/1.26.9 Jul 05 13:07:51.152895 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Auth-Token: gAAAAABixDemvGTS2azHCdp0cMUNYXxAY62x9uPXR5ImWDJ2EYV13Iblyl1wT8Qitlol2vzKY2VAuEDHiMiOwfh4yw8V4x_bcNQW6iShQ7pDGFibqdQ5i_wbEroGiGkS2qpesPgXuQvUJIvfH4gdYURuM32hpro5ldcRb32d9j3RanFSjkQhcd0 Jul 05 13:07:51.152895 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Domain-Id: None Jul 05 13:07:51.152895 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Domain-Name: None Jul 05 13:07:51.152895 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Identity-Status: Confirmed Jul 05 13:07:51.152895 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Is-Admin-Project: True Jul 05 13:07:51.152895 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Domain-Id: default Jul 05 13:07:51.152895 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Domain-Name: Default Jul 05 13:07:51.152895 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Id: 21152f748d68413ca8f807e5111ab8a3 Jul 05 13:07:51.152895 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Name: tempest-VolumesNegativeTest-339578529 Jul 05 13:07:51.152895 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Role: member,reader Jul 05 13:07:51.152895 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Roles: member,reader Jul 05 13:07:51.154426 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/21152f748d68413ca8f807e5111ab8a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_21152f748d68413ca8f807e5111ab8a3", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/21152f748d68413ca8f807e5111ab8a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/21152f748d68413ca8f807e5111ab8a3"}]}] Jul 05 13:07:51.154426 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Tenant: tempest-VolumesNegativeTest-339578529 Jul 05 13:07:51.154426 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Tenant-Id: 21152f748d68413ca8f807e5111ab8a3 Jul 05 13:07:51.154426 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Tenant-Name: tempest-VolumesNegativeTest-339578529 Jul 05 13:07:51.154426 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User: tempest-VolumesNegativeTest-339578529-project Jul 05 13:07:51.154426 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Domain-Id: default Jul 05 13:07:51.154426 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Domain-Name: Default Jul 05 13:07:51.154426 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Id: a0c6d56f4960497b85e1e171db8a3065 Jul 05 13:07:51.154426 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Name: tempest-VolumesNegativeTest-339578529-project Jul 05 13:07:51.154426 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Jul 05 13:07:51.154426 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2039973629", "metadata": {"Type": "work"}}} Jul 05 13:07:51.154426 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: method: Jul 05 13:07:51.154426 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 05 13:07:51.155410 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2039973629', 'metadata': {'Type': 'work'}}}} Jul 05 13:07:51.155410 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 13:07:51.155410 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:07:51.155410 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 05 13:07:51.155410 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 05 13:07:51.155410 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 05 13:07:51.155410 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi raise error Jul 05 13:07:51.155410 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 05 13:07:51.155410 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:07:51.155410 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 05 13:07:51.155410 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 05 13:07:51.155410 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:07:51.155410 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 05 13:07:51.155410 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi '0' Jul 05 13:07:51.155410 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:07:51.155410 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:07:51.155410 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:07:51.155410 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:07:51.155410 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:07:51.155410 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:07:51.155410 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 13:07:51.155410 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 13:07:51.156788 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 05 13:07:51.156788 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 05 13:07:51.156788 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 13:07:51.156788 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 13:07:51.156788 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 05 13:07:51.156788 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 05 13:07:51.156788 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 05 13:07:51.156788 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 05 13:07:51.156788 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 05 13:07:51.156788 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 05 13:07:51.156788 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 05 13:07:51.156788 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:07:51.156788 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:07:51.156788 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:07:51.156788 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:07:51.156788 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:07:51.156788 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:07:51.156788 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 05 13:07:51.156788 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 05 13:07:51.158011 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 05 13:07:51.158011 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:07:51.158011 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-690ba452-2268-49fa-a5c6-c881be6ebd2d tempest-VolumesNegativeTest-339578529 tempest-VolumesNegativeTest-339578529-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 13:07:51.158011 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-690ba452-2268-49fa-a5c6-c881be6ebd2d tempest-VolumesNegativeTest-339578529 tempest-VolumesNegativeTest-339578529-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008588 Jul 05 13:07:51.158011 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 440/892] 10.222.0.36 () {60 vars in 1155 bytes} [Tue Jul 5 13:07:51 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 05 13:07:51.163236 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-cd975f68-f463-446d-8dc8-4952f3e96b2e tempest-VolumesNegativeTest-339578529 tempest-VolumesNegativeTest-339578529-project] Action: 'create', calling method: .version_select at 0x7f70de6d7550>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1301221903", "metadata": {"Type": "work"}}} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:07:51.166064 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-cd975f68-f463-446d-8dc8-4952f3e96b2e tempest-VolumesNegativeTest-339578529 tempest-VolumesNegativeTest-339578529-project] Request method failure captured: Jul 05 13:07:51.166064 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 05 13:07:51.166064 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept: application/json Jul 05 13:07:51.166064 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept-Encoding: identity Jul 05 13:07:51.166064 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Connection: close Jul 05 13:07:51.166064 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Length: 119 Jul 05 13:07:51.166064 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Type: application/json Jul 05 13:07:51.166064 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Host: 10.222.0.36 Jul 05 13:07:51.166064 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Openstack-System-Scope: None Jul 05 13:07:51.166064 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: User-Agent: python-urllib3/1.26.9 Jul 05 13:07:51.166064 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Auth-Token: gAAAAABixDemvGTS2azHCdp0cMUNYXxAY62x9uPXR5ImWDJ2EYV13Iblyl1wT8Qitlol2vzKY2VAuEDHiMiOwfh4yw8V4x_bcNQW6iShQ7pDGFibqdQ5i_wbEroGiGkS2qpesPgXuQvUJIvfH4gdYURuM32hpro5ldcRb32d9j3RanFSjkQhcd0 Jul 05 13:07:51.166064 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Id: None Jul 05 13:07:51.166064 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Name: None Jul 05 13:07:51.166064 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Identity-Status: Confirmed Jul 05 13:07:51.166064 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Is-Admin-Project: True Jul 05 13:07:51.166064 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Id: default Jul 05 13:07:51.166064 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Name: Default Jul 05 13:07:51.166064 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Id: 21152f748d68413ca8f807e5111ab8a3 Jul 05 13:07:51.166064 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Name: tempest-VolumesNegativeTest-339578529 Jul 05 13:07:51.166064 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Role: member,reader Jul 05 13:07:51.166064 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Roles: member,reader Jul 05 13:07:51.167601 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/21152f748d68413ca8f807e5111ab8a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_21152f748d68413ca8f807e5111ab8a3", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/21152f748d68413ca8f807e5111ab8a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/21152f748d68413ca8f807e5111ab8a3"}]}] Jul 05 13:07:51.167601 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant: tempest-VolumesNegativeTest-339578529 Jul 05 13:07:51.167601 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Id: 21152f748d68413ca8f807e5111ab8a3 Jul 05 13:07:51.167601 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Name: tempest-VolumesNegativeTest-339578529 Jul 05 13:07:51.167601 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User: tempest-VolumesNegativeTest-339578529-project Jul 05 13:07:51.167601 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Id: default Jul 05 13:07:51.167601 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Name: Default Jul 05 13:07:51.167601 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Id: a0c6d56f4960497b85e1e171db8a3065 Jul 05 13:07:51.167601 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Name: tempest-VolumesNegativeTest-339578529-project Jul 05 13:07:51.167601 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Jul 05 13:07:51.167601 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1301221903", "metadata": {"Type": "work"}}} Jul 05 13:07:51.167601 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: method: Jul 05 13:07:51.167601 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 05 13:07:51.168970 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1301221903', 'metadata': {'Type': 'work'}}}} Jul 05 13:07:51.168970 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 13:07:51.168970 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:07:51.168970 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 05 13:07:51.168970 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 05 13:07:51.168970 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 05 13:07:51.168970 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise error Jul 05 13:07:51.168970 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 05 13:07:51.168970 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:07:51.168970 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 05 13:07:51.168970 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 05 13:07:51.168970 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:07:51.168970 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 05 13:07:51.168970 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi '' Jul 05 13:07:51.168970 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:07:51.168970 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:07:51.168970 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:07:51.168970 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:07:51.168970 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:07:51.168970 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:07:51.168970 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 13:07:51.168970 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 13:07:51.170522 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 05 13:07:51.170522 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 05 13:07:51.170522 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 13:07:51.170522 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 13:07:51.170522 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 05 13:07:51.170522 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 05 13:07:51.170522 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 05 13:07:51.170522 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 05 13:07:51.170522 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 05 13:07:51.170522 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 05 13:07:51.170522 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 05 13:07:51.170522 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:07:51.170522 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:07:51.170522 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:07:51.170522 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:07:51.170522 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:07:51.170522 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:07:51.170522 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 05 13:07:51.170522 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 05 13:07:51.171853 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 05 13:07:51.171853 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:07:51.171853 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-cd975f68-f463-446d-8dc8-4952f3e96b2e tempest-VolumesNegativeTest-339578529 tempest-VolumesNegativeTest-339578529-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 13:07:51.171853 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-cd975f68-f463-446d-8dc8-4952f3e96b2e tempest-VolumesNegativeTest-339578529 tempest-VolumesNegativeTest-339578529-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007921 Jul 05 13:07:51.171853 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 453/893] 10.222.0.36 () {60 vars in 1155 bytes} [Tue Jul 5 13:07:51 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 05 13:07:51.176369 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-e243fbb4-758a-4a97-961a-eb967171e448 tempest-VolumesNegativeTest-339578529 tempest-VolumesNegativeTest-339578529-project] Calling method '.version_select at 0x7f70de6dc940>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:51.203955 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.wsgi [None req-e243fbb4-758a-4a97-961a-eb967171e448 tempest-VolumesNegativeTest-339578529 tempest-VolumesNegativeTest-339578529-project] HTTP exception thrown: Volume tempest-invalid-2098157101 could not be found. Jul 05 13:07:51.205915 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-e243fbb4-758a-4a97-961a-eb967171e448 tempest-VolumesNegativeTest-339578529 tempest-VolumesNegativeTest-339578529-project] Request method failure captured: Jul 05 13:07:51.205915 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2098157101 HTTP/1.1 Jul 05 13:07:51.205915 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Accept: application/json Jul 05 13:07:51.205915 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Accept-Encoding: identity Jul 05 13:07:51.205915 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Connection: close Jul 05 13:07:51.205915 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Content-Length: 0 Jul 05 13:07:51.205915 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Content-Type: application/json Jul 05 13:07:51.205915 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Host: 10.222.0.36 Jul 05 13:07:51.205915 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Openstack-System-Scope: None Jul 05 13:07:51.205915 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: User-Agent: python-urllib3/1.26.9 Jul 05 13:07:51.205915 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Auth-Token: gAAAAABixDemvGTS2azHCdp0cMUNYXxAY62x9uPXR5ImWDJ2EYV13Iblyl1wT8Qitlol2vzKY2VAuEDHiMiOwfh4yw8V4x_bcNQW6iShQ7pDGFibqdQ5i_wbEroGiGkS2qpesPgXuQvUJIvfH4gdYURuM32hpro5ldcRb32d9j3RanFSjkQhcd0 Jul 05 13:07:51.205915 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Domain-Id: None Jul 05 13:07:51.205915 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Domain-Name: None Jul 05 13:07:51.205915 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Identity-Status: Confirmed Jul 05 13:07:51.205915 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Is-Admin-Project: True Jul 05 13:07:51.205915 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Domain-Id: default Jul 05 13:07:51.205915 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Domain-Name: Default Jul 05 13:07:51.205915 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Id: 21152f748d68413ca8f807e5111ab8a3 Jul 05 13:07:51.205915 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Name: tempest-VolumesNegativeTest-339578529 Jul 05 13:07:51.205915 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Role: member,reader Jul 05 13:07:51.205915 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Roles: member,reader Jul 05 13:07:51.207509 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/21152f748d68413ca8f807e5111ab8a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_21152f748d68413ca8f807e5111ab8a3", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/21152f748d68413ca8f807e5111ab8a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/21152f748d68413ca8f807e5111ab8a3"}]}] Jul 05 13:07:51.207509 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Tenant: tempest-VolumesNegativeTest-339578529 Jul 05 13:07:51.207509 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Tenant-Id: 21152f748d68413ca8f807e5111ab8a3 Jul 05 13:07:51.207509 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Tenant-Name: tempest-VolumesNegativeTest-339578529 Jul 05 13:07:51.207509 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User: tempest-VolumesNegativeTest-339578529-project Jul 05 13:07:51.207509 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Domain-Id: default Jul 05 13:07:51.207509 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Domain-Name: Default Jul 05 13:07:51.207509 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Id: a0c6d56f4960497b85e1e171db8a3065 Jul 05 13:07:51.207509 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Name: tempest-VolumesNegativeTest-339578529-project Jul 05 13:07:51.207509 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: method: Jul 05 13:07:51.207509 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: exception: Volume tempest-invalid-2098157101 could not be found. Jul 05 13:07:51.207509 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: action_args: {'id': 'tempest-invalid-2098157101'} Jul 05 13:07:51.207509 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 13:07:51.208463 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:07:51.208463 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 05 13:07:51.208463 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 05 13:07:51.208463 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 05 13:07:51.208463 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 05 13:07:51.208463 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 05 13:07:51.208463 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 05 13:07:51.208463 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 05 13:07:51.208463 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 05 13:07:51.208463 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 05 13:07:51.208463 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 05 13:07:51.208463 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 05 13:07:51.208463 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 05 13:07:51.208463 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 05 13:07:51.208463 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 05 13:07:51.208463 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2098157101 could not be found. (HTTP 404) (Request-ID: req-838f887b-cb3f-4be5-a9d0-d4f8dd528123) Jul 05 13:07:51.208463 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:07:51.208463 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:07:51.208463 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:07:51.209893 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:07:51.209893 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 05 13:07:51.209893 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 05 13:07:51.209893 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 05 13:07:51.209893 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 05 13:07:51.209893 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 05 13:07:51.209893 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 05 13:07:51.209893 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 05 13:07:51.209893 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 05 13:07:51.209893 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 05 13:07:51.209893 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 05 13:07:51.209893 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 05 13:07:51.209893 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 05 13:07:51.209893 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 05 13:07:51.209893 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 05 13:07:51.209893 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 05 13:07:51.209893 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 05 13:07:51.209893 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 05 13:07:51.209893 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 05 13:07:51.211120 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 05 13:07:51.211120 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 05 13:07:51.211120 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 05 13:07:51.211120 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 05 13:07:51.211120 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2098157101 could not be found. Jul 05 13:07:51.211120 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:07:51.211120 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:07:51.211120 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:07:51.211120 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:07:51.211120 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:07:51.211120 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:07:51.211120 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 13:07:51.211120 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 13:07:51.211120 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 05 13:07:51.211120 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 05 13:07:51.211120 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 13:07:51.211120 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 13:07:51.211120 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 05 13:07:51.211120 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 13:07:51.211120 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2098157101 could not be found. Jul 05 13:07:51.213191 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:07:51.213191 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:07:51.213191 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:07:51.213191 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:07:51.213191 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:07:51.213191 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:07:51.213191 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 13:07:51.213191 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 13:07:51.213191 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2098157101 could not be found. Jul 05 13:07:51.213191 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:07:51.213191 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-e243fbb4-758a-4a97-961a-eb967171e448 tempest-VolumesNegativeTest-339578529 tempest-VolumesNegativeTest-339578529-project] Returning 404 to user: Volume tempest-invalid-2098157101 could not be found. {{(pid=118386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 13:07:51.213191 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-e243fbb4-758a-4a97-961a-eb967171e448 tempest-VolumesNegativeTest-339578529 tempest-VolumesNegativeTest-339578529-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2098157101" status: 404 len: 99 microversion: 2.1 time: 0.034559 Jul 05 13:07:51.213191 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 441/894] 10.222.0.36 () {58 vars in 1217 bytes} [Tue Jul 5 13:07:51 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2098157101 => generated 99 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 05 13:07:51.218010 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-dec7146b-950a-44db-b14f-93f60faa42a8 tempest-VolumesNegativeTest-339578529 tempest-VolumesNegativeTest-339578529-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003674 Jul 05 13:07:51.218530 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 454/895] 10.222.0.36 () {58 vars in 1139 bytes} [Tue Jul 5 13:07:51 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 05 13:07:51.228515 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-64c96acc-9d9b-4284-84aa-350723d3f65d tempest-VolumesNegativeTest-339578529 tempest-VolumesNegativeTest-339578529-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004687 Jul 05 13:07:51.229172 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 442/896] 10.222.0.36 () {58 vars in 1136 bytes} [Tue Jul 5 13:07:51 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jul 05 13:07:51.237393 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-8936c469-2099-4778-bf9e-0a042a531237 tempest-VolumesNegativeTest-339578529 tempest-VolumesNegativeTest-339578529-project] Calling method '.version_select at 0x7f70de6eb280>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:51.264731 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.wsgi [None req-8936c469-2099-4778-bf9e-0a042a531237 tempest-VolumesNegativeTest-339578529 tempest-VolumesNegativeTest-339578529-project] HTTP exception thrown: Volume ed8f7b1b-ebb0-40b7-a02f-da3a378a473d could not be found. Jul 05 13:07:51.266696 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-8936c469-2099-4778-bf9e-0a042a531237 tempest-VolumesNegativeTest-339578529 tempest-VolumesNegativeTest-339578529-project] Request method failure captured: Jul 05 13:07:51.266696 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: request: DELETE /compute/v2.1/os-volumes/ed8f7b1b-ebb0-40b7-a02f-da3a378a473d HTTP/1.1 Jul 05 13:07:51.266696 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept: application/json Jul 05 13:07:51.266696 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept-Encoding: identity Jul 05 13:07:51.266696 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Connection: close Jul 05 13:07:51.266696 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Length: 0 Jul 05 13:07:51.266696 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Type: application/json Jul 05 13:07:51.266696 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Host: 10.222.0.36 Jul 05 13:07:51.266696 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Openstack-System-Scope: None Jul 05 13:07:51.266696 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: User-Agent: python-urllib3/1.26.9 Jul 05 13:07:51.266696 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Auth-Token: gAAAAABixDemvGTS2azHCdp0cMUNYXxAY62x9uPXR5ImWDJ2EYV13Iblyl1wT8Qitlol2vzKY2VAuEDHiMiOwfh4yw8V4x_bcNQW6iShQ7pDGFibqdQ5i_wbEroGiGkS2qpesPgXuQvUJIvfH4gdYURuM32hpro5ldcRb32d9j3RanFSjkQhcd0 Jul 05 13:07:51.266696 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Id: None Jul 05 13:07:51.266696 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Name: None Jul 05 13:07:51.266696 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Identity-Status: Confirmed Jul 05 13:07:51.266696 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Is-Admin-Project: True Jul 05 13:07:51.266696 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Id: default Jul 05 13:07:51.266696 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Name: Default Jul 05 13:07:51.266696 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Id: 21152f748d68413ca8f807e5111ab8a3 Jul 05 13:07:51.266696 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Name: tempest-VolumesNegativeTest-339578529 Jul 05 13:07:51.266696 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Role: member,reader Jul 05 13:07:51.266696 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Roles: member,reader Jul 05 13:07:51.268250 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/21152f748d68413ca8f807e5111ab8a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_21152f748d68413ca8f807e5111ab8a3", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/21152f748d68413ca8f807e5111ab8a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/21152f748d68413ca8f807e5111ab8a3"}]}] Jul 05 13:07:51.268250 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant: tempest-VolumesNegativeTest-339578529 Jul 05 13:07:51.268250 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Id: 21152f748d68413ca8f807e5111ab8a3 Jul 05 13:07:51.268250 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Name: tempest-VolumesNegativeTest-339578529 Jul 05 13:07:51.268250 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User: tempest-VolumesNegativeTest-339578529-project Jul 05 13:07:51.268250 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Id: default Jul 05 13:07:51.268250 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Name: Default Jul 05 13:07:51.268250 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Id: a0c6d56f4960497b85e1e171db8a3065 Jul 05 13:07:51.268250 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Name: tempest-VolumesNegativeTest-339578529-project Jul 05 13:07:51.268250 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: method: Jul 05 13:07:51.268250 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: exception: Volume ed8f7b1b-ebb0-40b7-a02f-da3a378a473d could not be found. Jul 05 13:07:51.268250 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: action_args: {'id': 'ed8f7b1b-ebb0-40b7-a02f-da3a378a473d'} Jul 05 13:07:51.268250 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 13:07:51.269284 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:07:51.269284 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 05 13:07:51.269284 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 05 13:07:51.269284 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 05 13:07:51.269284 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 05 13:07:51.269284 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 05 13:07:51.269284 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 05 13:07:51.269284 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 05 13:07:51.269284 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 05 13:07:51.269284 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 05 13:07:51.269284 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 05 13:07:51.269284 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 05 13:07:51.269284 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 05 13:07:51.269284 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 05 13:07:51.269284 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 05 13:07:51.269284 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ed8f7b1b-ebb0-40b7-a02f-da3a378a473d could not be found. (HTTP 404) (Request-ID: req-497c5762-550d-4c87-804c-62decc68b138) Jul 05 13:07:51.269284 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:07:51.269284 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:07:51.269284 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:07:51.270794 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:07:51.270794 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 05 13:07:51.270794 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 05 13:07:51.270794 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 05 13:07:51.270794 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 05 13:07:51.270794 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 05 13:07:51.270794 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 05 13:07:51.270794 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 05 13:07:51.270794 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 05 13:07:51.270794 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 05 13:07:51.270794 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 05 13:07:51.270794 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 05 13:07:51.270794 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 05 13:07:51.270794 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 05 13:07:51.270794 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 05 13:07:51.270794 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 05 13:07:51.270794 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 05 13:07:51.270794 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 05 13:07:51.270794 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 05 13:07:51.272095 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 05 13:07:51.272095 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 05 13:07:51.272095 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 05 13:07:51.272095 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 05 13:07:51.272095 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ed8f7b1b-ebb0-40b7-a02f-da3a378a473d could not be found. Jul 05 13:07:51.272095 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:07:51.272095 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:07:51.272095 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:07:51.272095 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:07:51.272095 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:07:51.272095 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:07:51.272095 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 13:07:51.272095 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 13:07:51.272095 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 05 13:07:51.272095 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 05 13:07:51.272095 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 13:07:51.272095 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 13:07:51.272095 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 05 13:07:51.272095 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 13:07:51.273857 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ed8f7b1b-ebb0-40b7-a02f-da3a378a473d could not be found. Jul 05 13:07:51.273857 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:07:51.273857 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:07:51.273857 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:07:51.273857 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:07:51.273857 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:07:51.273857 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:07:51.273857 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 13:07:51.273857 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 13:07:51.273857 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ed8f7b1b-ebb0-40b7-a02f-da3a378a473d could not be found. Jul 05 13:07:51.273857 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:07:51.273857 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-8936c469-2099-4778-bf9e-0a042a531237 tempest-VolumesNegativeTest-339578529 tempest-VolumesNegativeTest-339578529-project] Returning 404 to user: Volume ed8f7b1b-ebb0-40b7-a02f-da3a378a473d could not be found. {{(pid=118387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 13:07:51.273857 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-8936c469-2099-4778-bf9e-0a042a531237 tempest-VolumesNegativeTest-339578529 tempest-VolumesNegativeTest-339578529-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/ed8f7b1b-ebb0-40b7-a02f-da3a378a473d" status: 404 len: 109 microversion: 2.1 time: 0.034165 Jul 05 13:07:51.273857 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 455/897] 10.222.0.36 () {58 vars in 1247 bytes} [Tue Jul 5 13:07:51 2022] DELETE /compute/v2.1/os-volumes/ed8f7b1b-ebb0-40b7-a02f-da3a378a473d => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 13:07:51.278794 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-c0ad3b75-2890-4898-831c-ea4ed0cd0f88 tempest-VolumesNegativeTest-339578529 tempest-VolumesNegativeTest-339578529-project] Calling method '.version_select at 0x7f70de923430>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:51.305479 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.wsgi [None req-c0ad3b75-2890-4898-831c-ea4ed0cd0f88 tempest-VolumesNegativeTest-339578529 tempest-VolumesNegativeTest-339578529-project] HTTP exception thrown: Volume 24f36ecf-1f6a-459d-b57a-3fe507ea9c69 could not be found. Jul 05 13:07:51.307441 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-c0ad3b75-2890-4898-831c-ea4ed0cd0f88 tempest-VolumesNegativeTest-339578529 tempest-VolumesNegativeTest-339578529-project] Request method failure captured: Jul 05 13:07:51.307441 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: request: GET /compute/v2.1/os-volumes/24f36ecf-1f6a-459d-b57a-3fe507ea9c69 HTTP/1.1 Jul 05 13:07:51.307441 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Accept: application/json Jul 05 13:07:51.307441 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Accept-Encoding: identity Jul 05 13:07:51.307441 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Connection: close Jul 05 13:07:51.307441 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Content-Length: 0 Jul 05 13:07:51.307441 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Content-Type: application/json Jul 05 13:07:51.307441 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Host: 10.222.0.36 Jul 05 13:07:51.307441 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Openstack-System-Scope: None Jul 05 13:07:51.307441 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: User-Agent: python-urllib3/1.26.9 Jul 05 13:07:51.307441 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Auth-Token: gAAAAABixDemvGTS2azHCdp0cMUNYXxAY62x9uPXR5ImWDJ2EYV13Iblyl1wT8Qitlol2vzKY2VAuEDHiMiOwfh4yw8V4x_bcNQW6iShQ7pDGFibqdQ5i_wbEroGiGkS2qpesPgXuQvUJIvfH4gdYURuM32hpro5ldcRb32d9j3RanFSjkQhcd0 Jul 05 13:07:51.307441 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Domain-Id: None Jul 05 13:07:51.307441 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Domain-Name: None Jul 05 13:07:51.307441 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Identity-Status: Confirmed Jul 05 13:07:51.307441 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Is-Admin-Project: True Jul 05 13:07:51.307441 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Domain-Id: default Jul 05 13:07:51.307441 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Domain-Name: Default Jul 05 13:07:51.307441 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Id: 21152f748d68413ca8f807e5111ab8a3 Jul 05 13:07:51.307441 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Name: tempest-VolumesNegativeTest-339578529 Jul 05 13:07:51.307441 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Role: member,reader Jul 05 13:07:51.307441 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Roles: member,reader Jul 05 13:07:51.309036 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/21152f748d68413ca8f807e5111ab8a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_21152f748d68413ca8f807e5111ab8a3", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/21152f748d68413ca8f807e5111ab8a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/21152f748d68413ca8f807e5111ab8a3"}]}] Jul 05 13:07:51.309036 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Tenant: tempest-VolumesNegativeTest-339578529 Jul 05 13:07:51.309036 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Tenant-Id: 21152f748d68413ca8f807e5111ab8a3 Jul 05 13:07:51.309036 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Tenant-Name: tempest-VolumesNegativeTest-339578529 Jul 05 13:07:51.309036 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User: tempest-VolumesNegativeTest-339578529-project Jul 05 13:07:51.309036 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Domain-Id: default Jul 05 13:07:51.309036 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Domain-Name: Default Jul 05 13:07:51.309036 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Id: a0c6d56f4960497b85e1e171db8a3065 Jul 05 13:07:51.309036 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Name: tempest-VolumesNegativeTest-339578529-project Jul 05 13:07:51.309036 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: method: Jul 05 13:07:51.309036 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: exception: Volume 24f36ecf-1f6a-459d-b57a-3fe507ea9c69 could not be found. Jul 05 13:07:51.309036 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: action_args: {'id': '24f36ecf-1f6a-459d-b57a-3fe507ea9c69'} Jul 05 13:07:51.309036 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 13:07:51.310035 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:07:51.310035 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 05 13:07:51.310035 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 05 13:07:51.310035 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 05 13:07:51.310035 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 05 13:07:51.310035 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 05 13:07:51.310035 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 05 13:07:51.310035 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 05 13:07:51.310035 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 05 13:07:51.310035 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 05 13:07:51.310035 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 05 13:07:51.310035 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 05 13:07:51.310035 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 05 13:07:51.310035 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 05 13:07:51.310035 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 05 13:07:51.310035 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 24f36ecf-1f6a-459d-b57a-3fe507ea9c69 could not be found. (HTTP 404) (Request-ID: req-1b6a4990-e9e8-4bc4-bc39-cb7e8272375f) Jul 05 13:07:51.310035 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:07:51.310035 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:07:51.310035 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:07:51.311450 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:07:51.311450 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 05 13:07:51.311450 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 05 13:07:51.311450 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 05 13:07:51.311450 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 05 13:07:51.311450 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 05 13:07:51.311450 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 05 13:07:51.311450 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 05 13:07:51.311450 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 05 13:07:51.311450 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 05 13:07:51.311450 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 05 13:07:51.311450 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 05 13:07:51.311450 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 05 13:07:51.311450 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 05 13:07:51.311450 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 05 13:07:51.311450 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 05 13:07:51.311450 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 05 13:07:51.311450 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 05 13:07:51.311450 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 05 13:07:51.312683 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 05 13:07:51.312683 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 05 13:07:51.312683 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 05 13:07:51.312683 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 05 13:07:51.312683 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 24f36ecf-1f6a-459d-b57a-3fe507ea9c69 could not be found. Jul 05 13:07:51.312683 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:07:51.312683 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:07:51.312683 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:07:51.312683 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:07:51.312683 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:07:51.312683 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:07:51.312683 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 13:07:51.312683 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 13:07:51.312683 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 05 13:07:51.312683 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 05 13:07:51.312683 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 13:07:51.312683 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 13:07:51.312683 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 05 13:07:51.312683 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 13:07:51.314031 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 24f36ecf-1f6a-459d-b57a-3fe507ea9c69 could not be found. Jul 05 13:07:51.314031 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:07:51.314031 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:07:51.314031 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:07:51.314031 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:07:51.314031 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:07:51.314031 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:07:51.314031 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 13:07:51.314031 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 13:07:51.314031 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 24f36ecf-1f6a-459d-b57a-3fe507ea9c69 could not be found. Jul 05 13:07:51.314031 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:07:51.314031 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-c0ad3b75-2890-4898-831c-ea4ed0cd0f88 tempest-VolumesNegativeTest-339578529 tempest-VolumesNegativeTest-339578529-project] Returning 404 to user: Volume 24f36ecf-1f6a-459d-b57a-3fe507ea9c69 could not be found. {{(pid=118386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 13:07:51.314031 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-c0ad3b75-2890-4898-831c-ea4ed0cd0f88 tempest-VolumesNegativeTest-339578529 tempest-VolumesNegativeTest-339578529-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/24f36ecf-1f6a-459d-b57a-3fe507ea9c69" status: 404 len: 109 microversion: 2.1 time: 0.033919 Jul 05 13:07:51.314031 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 443/898] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Jul 5 13:07:51 2022] GET /compute/v2.1/os-volumes/24f36ecf-1f6a-459d-b57a-3fe507ea9c69 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 13:07:51.425030 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-474c88c3-8d8a-4213-b571-2d658e208ccf tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:51.425030 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-474c88c3-8d8a-4213-b571-2d658e208ccf tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: 0bcc1600-ecfa-4cf0-929c-03cd036d07c3] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:51.426972 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-474c88c3-8d8a-4213-b571-2d658e208ccf tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:51.427422 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-474c88c3-8d8a-4213-b571-2d658e208ccf tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:51.428187 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-474c88c3-8d8a-4213-b571-2d658e208ccf tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:51.428645 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-474c88c3-8d8a-4213-b571-2d658e208ccf tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:51.556774 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-474c88c3-8d8a-4213-b571-2d658e208ccf tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661062780f5c45d180a05e402fc7bc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277fa3c89dff47b88894b781ff69fb70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:51.564270 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-474c88c3-8d8a-4213-b571-2d658e208ccf tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/0bcc1600-ecfa-4cf0-929c-03cd036d07c3" status: 200 len: 1453 microversion: 2.1 time: 0.148385 Jul 05 13:07:51.564858 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 456/899] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:07:51 2022] GET /compute/v2.1/servers/0bcc1600-ecfa-4cf0-929c-03cd036d07c3 => generated 1453 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:07:51.580500 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-3bdb2b1c-f533-4a85-b6da-13d7d3b1ce68 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:07:51.581160 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-3bdb2b1c-f533-4a85-b6da-13d7d3b1ce68 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: 0bcc1600-ecfa-4cf0-929c-03cd036d07c3] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:07:51.588251 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-3bdb2b1c-f533-4a85-b6da-13d7d3b1ce68 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:51.588770 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-3bdb2b1c-f533-4a85-b6da-13d7d3b1ce68 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:51.589526 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-3bdb2b1c-f533-4a85-b6da-13d7d3b1ce68 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:51.589958 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-3bdb2b1c-f533-4a85-b6da-13d7d3b1ce68 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:51.717229 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-3bdb2b1c-f533-4a85-b6da-13d7d3b1ce68 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661062780f5c45d180a05e402fc7bc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277fa3c89dff47b88894b781ff69fb70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:07:51.724626 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-3bdb2b1c-f533-4a85-b6da-13d7d3b1ce68 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/0bcc1600-ecfa-4cf0-929c-03cd036d07c3" status: 200 len: 1453 microversion: 2.1 time: 0.147822 Jul 05 13:07:51.725179 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 444/900] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:07:51 2022] GET /compute/v2.1/servers/0bcc1600-ecfa-4cf0-929c-03cd036d07c3 => generated 1453 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:07:53.757571 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-6a1f3b68-6cab-4685-959d-1d4548a69f04 req-13bcefec-ab7b-4c70-af77-9abf986cf74c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bcc1600-ecfa-4cf0-929c-03cd036d07c3", "tag": "d010e1f8-d442-4111-a65d-8c9e9e080c9f"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:07:53.767486 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-6a1f3b68-6cab-4685-959d-1d4548a69f04 req-13bcefec-ab7b-4c70-af77-9abf986cf74c service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:07:53.767851 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-6a1f3b68-6cab-4685-959d-1d4548a69f04 req-13bcefec-ab7b-4c70-af77-9abf986cf74c service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:07:53.778946 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-6a1f3b68-6cab-4685-959d-1d4548a69f04 req-13bcefec-ab7b-4c70-af77-9abf986cf74c service nova] Creating event network-changed:d010e1f8-d442-4111-a65d-8c9e9e080c9f for instance 0bcc1600-ecfa-4cf0-929c-03cd036d07c3 on hv-cinder-79760 Jul 05 13:07:53.784733 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-6a1f3b68-6cab-4685-959d-1d4548a69f04 req-13bcefec-ab7b-4c70-af77-9abf986cf74c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030612 Jul 05 13:07:53.785379 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 457/901] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:08:07.938269 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-5e166022-039a-46fe-af7c-b02922425c86 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:08:07.938808 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-5e166022-039a-46fe-af7c-b02922425c86 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:08:07.940917 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=1 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:07.941639 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_cell1:SELECT=68,nova_cell1:INSERT=1 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:07.946377 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-5e166022-039a-46fe-af7c-b02922425c86 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:07.952437 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-5e166022-039a-46fe-af7c-b02922425c86 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:07.952437 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-5e166022-039a-46fe-af7c-b02922425c86 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:07.952437 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-5e166022-039a-46fe-af7c-b02922425c86 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:07.974557 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-5e166022-039a-46fe-af7c-b02922425c86 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25/ips" status: 200 len: 145 microversion: 2.1 time: 0.040314 Jul 05 13:08:07.975201 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 445/902] 10.222.0.36 () {58 vars in 1247 bytes} [Tue Jul 5 13:08:07 2022] GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25/ips => generated 145 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:08:08.359920 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-1a399db1-a0bb-4577-9884-9f9122af14d3 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:08:08.361038 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-1a399db1-a0bb-4577-9884-9f9122af14d3 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:08:08.363393 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_api:SELECT=23 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:08.364042 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell1:SELECT=99 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:08.369432 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1a399db1-a0bb-4577-9884-9f9122af14d3 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:08.369887 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1a399db1-a0bb-4577-9884-9f9122af14d3 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:08.370661 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1a399db1-a0bb-4577-9884-9f9122af14d3 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:08.371150 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1a399db1-a0bb-4577-9884-9f9122af14d3 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:08.400174 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-1a399db1-a0bb-4577-9884-9f9122af14d3 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044278 Jul 05 13:08:08.400744 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 458/903] 10.222.0.36 () {60 vars in 1342 bytes} [Tue Jul 5 13:08:08 2022] GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:08:08.457579 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-e6cdfe7f-667a-4be7-9cce-d5fcff04b876 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:08:08.458071 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-e6cdfe7f-667a-4be7-9cce-d5fcff04b876 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:08:08.465143 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e6cdfe7f-667a-4be7-9cce-d5fcff04b876 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:08.465588 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e6cdfe7f-667a-4be7-9cce-d5fcff04b876 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:08.466340 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e6cdfe7f-667a-4be7-9cce-d5fcff04b876 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:08.466769 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e6cdfe7f-667a-4be7-9cce-d5fcff04b876 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:08.491180 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-e6cdfe7f-667a-4be7-9cce-d5fcff04b876 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Going to try to terminate instance {{(pid=118386) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 13:08:08.869075 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-e6cdfe7f-667a-4be7-9cce-d5fcff04b876 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "DELETE /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356" status: 204 len: 0 microversion: 2.20 time: 0.415134 Jul 05 13:08:08.869660 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 446/904] 10.222.0.36 () {60 vars in 1279 bytes} [Tue Jul 5 13:08:08 2022] DELETE /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 05 13:08:08.878321 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-1ac16e18-796e-49ac-8eb4-d14abe535a71 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:08:08.879026 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-1ac16e18-796e-49ac-8eb4-d14abe535a71 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:08:08.885698 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1ac16e18-796e-49ac-8eb4-d14abe535a71 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:08.886256 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1ac16e18-796e-49ac-8eb4-d14abe535a71 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:08.887062 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1ac16e18-796e-49ac-8eb4-d14abe535a71 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:08.887552 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1ac16e18-796e-49ac-8eb4-d14abe535a71 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:09.021018 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-1ac16e18-796e-49ac-8eb4-d14abe535a71 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:08:09.028901 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-1ac16e18-796e-49ac-8eb4-d14abe535a71 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:08:09.030413 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-1ac16e18-796e-49ac-8eb4-d14abe535a71 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:08:09.031596 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-1ac16e18-796e-49ac-8eb4-d14abe535a71 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356" status: 200 len: 1723 microversion: 2.20 time: 0.157472 Jul 05 13:08:09.032154 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 459/905] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:08:08 2022] GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:08:10.051969 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-5235e081-695c-4045-9e07-e3d34c0ed5f5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:08:10.052697 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-5235e081-695c-4045-9e07-e3d34c0ed5f5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:08:10.059617 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-5235e081-695c-4045-9e07-e3d34c0ed5f5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:10.062942 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-5235e081-695c-4045-9e07-e3d34c0ed5f5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:10.062942 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-5235e081-695c-4045-9e07-e3d34c0ed5f5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:10.062942 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-5235e081-695c-4045-9e07-e3d34c0ed5f5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:10.191488 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-5235e081-695c-4045-9e07-e3d34c0ed5f5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:08:10.200283 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-5235e081-695c-4045-9e07-e3d34c0ed5f5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:08:10.201852 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-5235e081-695c-4045-9e07-e3d34c0ed5f5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:08:10.202984 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-5235e081-695c-4045-9e07-e3d34c0ed5f5 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356" status: 200 len: 1723 microversion: 2.20 time: 0.155415 Jul 05 13:08:10.203529 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 447/906] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:08:10 2022] GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:08:11.221651 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-27955fc6-bf3d-483b-bbb0-f73b29eb9c10 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:08:11.223261 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-27955fc6-bf3d-483b-bbb0-f73b29eb9c10 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:08:11.230754 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-27955fc6-bf3d-483b-bbb0-f73b29eb9c10 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:11.231502 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-27955fc6-bf3d-483b-bbb0-f73b29eb9c10 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:11.232328 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-27955fc6-bf3d-483b-bbb0-f73b29eb9c10 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:11.233019 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-27955fc6-bf3d-483b-bbb0-f73b29eb9c10 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:11.299287 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-27955fc6-bf3d-483b-bbb0-f73b29eb9c10 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:08:11.308295 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-27955fc6-bf3d-483b-bbb0-f73b29eb9c10 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:08:11.311026 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-27955fc6-bf3d-483b-bbb0-f73b29eb9c10 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:08:11.312968 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-27955fc6-bf3d-483b-bbb0-f73b29eb9c10 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356" status: 200 len: 1655 microversion: 2.20 time: 0.095612 Jul 05 13:08:11.313804 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 460/907] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:08:11 2022] GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356 => generated 1655 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 13:08:11.394539 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [req-160384f0-798b-41ed-9fbf-4be271c324fd req-bdcea583-6010-4cd9-8c30-11e26f0d4e09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42411ae1-103e-4934-9594-aaf06cc8a356", "name": "network-vif-deleted", "tag": "0eb7994b-94fe-4d89-a3c9-6b498bab0720"}]} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:08:11.403466 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-160384f0-798b-41ed-9fbf-4be271c324fd req-bdcea583-6010-4cd9-8c30-11e26f0d4e09 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:11.403904 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-160384f0-798b-41ed-9fbf-4be271c324fd req-bdcea583-6010-4cd9-8c30-11e26f0d4e09 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:11.414595 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.compute.server_external_events [req-160384f0-798b-41ed-9fbf-4be271c324fd req-bdcea583-6010-4cd9-8c30-11e26f0d4e09 service nova] Creating event network-vif-deleted:0eb7994b-94fe-4d89-a3c9-6b498bab0720 for instance 42411ae1-103e-4934-9594-aaf06cc8a356 on hv-cinder-79760 Jul 05 13:08:11.420034 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [req-160384f0-798b-41ed-9fbf-4be271c324fd req-bdcea583-6010-4cd9-8c30-11e26f0d4e09 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029113 Jul 05 13:08:11.424759 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 448/908] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:08:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:08:12.331380 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-f43465ab-4d1a-40f3-b678-7048c39af83a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:08:12.331991 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-f43465ab-4d1a-40f3-b678-7048c39af83a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:08:12.338666 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f43465ab-4d1a-40f3-b678-7048c39af83a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:12.339210 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f43465ab-4d1a-40f3-b678-7048c39af83a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:12.340047 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f43465ab-4d1a-40f3-b678-7048c39af83a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:12.340497 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f43465ab-4d1a-40f3-b678-7048c39af83a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:12.373991 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f43465ab-4d1a-40f3-b678-7048c39af83a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:12.374442 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f43465ab-4d1a-40f3-b678-7048c39af83a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:12.374896 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.objects.instance [None req-f43465ab-4d1a-40f3-b678-7048c39af83a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lazy-loading 'fault' on Instance uuid 42411ae1-103e-4934-9594-aaf06cc8a356 {{(pid=118387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 13:08:12.420482 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-f43465ab-4d1a-40f3-b678-7048c39af83a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:08:12.427527 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-f43465ab-4d1a-40f3-b678-7048c39af83a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:08:12.429051 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-f43465ab-4d1a-40f3-b678-7048c39af83a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '475bac060a98475d858e6181eec7ce11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c201d76ac4e4cc08fdc38e7165d4764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:08:12.430210 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-f43465ab-4d1a-40f3-b678-7048c39af83a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356" status: 200 len: 1370 microversion: 2.20 time: 0.102830 Jul 05 13:08:12.431284 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 461/909] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:08:12 2022] GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356 => generated 1370 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 13:08:13.016039 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-fdd3621c-f306-45ac-96ba-326434e731ff tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "df864550-5675-46b6-ba12-b203281af196"}} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:08:13.017185 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-fdd3621c-f306-45ac-96ba-326434e731ff tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:08:13.023280 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-fdd3621c-f306-45ac-96ba-326434e731ff tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:13.023722 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-fdd3621c-f306-45ac-96ba-326434e731ff tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:13.025028 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-fdd3621c-f306-45ac-96ba-326434e731ff tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:13.025461 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-fdd3621c-f306-45ac-96ba-326434e731ff tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:13.449971 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-da1c3cec-bdf3-4af4-9808-a88ca931482a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:08:13.450699 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-da1c3cec-bdf3-4af4-9808-a88ca931482a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:08:13.457060 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-da1c3cec-bdf3-4af4-9808-a88ca931482a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:13.457504 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-da1c3cec-bdf3-4af4-9808-a88ca931482a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:13.458255 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-da1c3cec-bdf3-4af4-9808-a88ca931482a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:13.458687 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-da1c3cec-bdf3-4af4-9808-a88ca931482a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:13.471606 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.wsgi [None req-da1c3cec-bdf3-4af4-9808-a88ca931482a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] HTTP exception thrown: Instance 42411ae1-103e-4934-9594-aaf06cc8a356 could not be found. Jul 05 13:08:13.473280 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-da1c3cec-bdf3-4af4-9808-a88ca931482a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Request method failure captured: Jul 05 13:08:13.473280 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: request: GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356 HTTP/1.1 Jul 05 13:08:13.473280 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept: application/json Jul 05 13:08:13.473280 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept-Encoding: identity Jul 05 13:08:13.473280 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Connection: close Jul 05 13:08:13.473280 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Length: 0 Jul 05 13:08:13.473280 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Type: application/json Jul 05 13:08:13.473280 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Host: 10.222.0.36 Jul 05 13:08:13.473280 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Openstack-System-Scope: None Jul 05 13:08:13.473280 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: User-Agent: python-urllib3/1.26.9 Jul 05 13:08:13.473280 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Auth-Token: gAAAAABixDYU4XKFSG1QuYBUfrOR6esVXAvVAGSwtVHPu7LBdH9y2w_YzZETCWfsRdlNKtdKF1ZnCITRlR9D6eRFZEIctYOdEIyordTrOjyt8lpzMH7MZZMgDMWMYkmZd-zLknVG2Gu6MRGRZNFw44v144fi7JGPzg5WSXfnQTVCEpw58mz6RK4 Jul 05 13:08:13.473280 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Id: None Jul 05 13:08:13.473280 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Name: None Jul 05 13:08:13.473280 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Identity-Status: Confirmed Jul 05 13:08:13.473280 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Is-Admin-Project: True Jul 05 13:08:13.473280 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Openstack-Nova-Api-Version: 2.20 Jul 05 13:08:13.473280 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Id: default Jul 05 13:08:13.473280 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Name: Default Jul 05 13:08:13.473280 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Id: 6c201d76ac4e4cc08fdc38e7165d4764 Jul 05 13:08:13.473280 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-32891023 Jul 05 13:08:13.473280 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Role: member,reader Jul 05 13:08:13.473280 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Roles: member,reader Jul 05 13:08:13.474966 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6c201d76ac4e4cc08fdc38e7165d4764"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6c201d76ac4e4cc08fdc38e7165d4764", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6c201d76ac4e4cc08fdc38e7165d4764"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6c201d76ac4e4cc08fdc38e7165d4764"}]}] Jul 05 13:08:13.474966 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant: tempest-AttachVolumeShelveTestJSON-32891023 Jul 05 13:08:13.474966 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Id: 6c201d76ac4e4cc08fdc38e7165d4764 Jul 05 13:08:13.474966 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-32891023 Jul 05 13:08:13.474966 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User: tempest-AttachVolumeShelveTestJSON-32891023-project Jul 05 13:08:13.474966 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Id: default Jul 05 13:08:13.474966 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Name: Default Jul 05 13:08:13.474966 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Id: 475bac060a98475d858e6181eec7ce11 Jul 05 13:08:13.474966 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Name: tempest-AttachVolumeShelveTestJSON-32891023-project Jul 05 13:08:13.474966 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: method: > Jul 05 13:08:13.474966 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: exception: Instance 42411ae1-103e-4934-9594-aaf06cc8a356 could not be found. Jul 05 13:08:13.474966 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: action_args: {'id': '42411ae1-103e-4934-9594-aaf06cc8a356'} Jul 05 13:08:13.475894 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 13:08:13.475894 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:08:13.475894 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 13:08:13.475894 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 13:08:13.475894 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 13:08:13.475894 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 13:08:13.475894 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 13:08:13.475894 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 13:08:13.475894 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 13:08:13.475894 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 13:08:13.475894 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42411ae1-103e-4934-9594-aaf06cc8a356 could not be found. Jul 05 13:08:13.475894 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:08:13.475894 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:08:13.475894 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:08:13.475894 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:08:13.475894 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:08:13.475894 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:08:13.475894 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 13:08:13.475894 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 13:08:13.475894 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 13:08:13.478125 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 13:08:13.478125 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 13:08:13.478125 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 13:08:13.478125 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 13:08:13.478125 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 13:08:13.478125 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 13:08:13.478125 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 13:08:13.478125 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42411ae1-103e-4934-9594-aaf06cc8a356 could not be found. Jul 05 13:08:13.478125 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:08:13.478125 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:08:13.478125 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:08:13.478125 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:08:13.478125 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:08:13.478125 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:08:13.478125 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 13:08:13.478125 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 13:08:13.478125 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42411ae1-103e-4934-9594-aaf06cc8a356 could not be found. Jul 05 13:08:13.478125 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:08:13.479783 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-da1c3cec-bdf3-4af4-9808-a88ca931482a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Returning 404 to user: Instance 42411ae1-103e-4934-9594-aaf06cc8a356 could not be found. {{(pid=118387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 13:08:13.479783 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-da1c3cec-bdf3-4af4-9808-a88ca931482a tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356" status: 404 len: 111 microversion: 2.20 time: 0.028498 Jul 05 13:08:13.479783 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 462/910] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:08:13 2022] GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 05 13:08:13.485000 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-56ce0291-c3ab-4c40-8547-54fbfe100b6d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '.version_select at 0x7f70de72fee0>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:08:13.595905 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-56ce0291-c3ab-4c40-8547-54fbfe100b6d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-547496300" status: 204 len: 0 microversion: 2.20 time: 0.115745 Jul 05 13:08:13.599759 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 463/911] 10.222.0.36 () {60 vars in 1258 bytes} [Tue Jul 5 13:08:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-547496300 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 05 13:08:13.882508 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-fdd3621c-f306-45ac-96ba-326434e731ff tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "POST /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.870963 Jul 05 13:08:13.883210 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 449/912] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Jul 5 13:08:13 2022] POST /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25/os-volume_attachments => generated 194 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 13:08:15.794243 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-6f9109ec-1330-41e8-a2f9-1a57bba122e1 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:08:15.794756 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-6f9109ec-1330-41e8-a2f9-1a57bba122e1 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:08:15.801482 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6f9109ec-1330-41e8-a2f9-1a57bba122e1 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:15.801936 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6f9109ec-1330-41e8-a2f9-1a57bba122e1 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:15.802797 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6f9109ec-1330-41e8-a2f9-1a57bba122e1 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:15.803132 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6f9109ec-1330-41e8-a2f9-1a57bba122e1 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:15.816490 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.wsgi [None req-6f9109ec-1330-41e8-a2f9-1a57bba122e1 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] HTTP exception thrown: Instance 42411ae1-103e-4934-9594-aaf06cc8a356 could not be found. Jul 05 13:08:15.818138 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-6f9109ec-1330-41e8-a2f9-1a57bba122e1 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Request method failure captured: Jul 05 13:08:15.818138 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: request: DELETE /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356 HTTP/1.1 Jul 05 13:08:15.818138 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept: application/json Jul 05 13:08:15.818138 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept-Encoding: identity Jul 05 13:08:15.818138 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Connection: close Jul 05 13:08:15.818138 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Length: 0 Jul 05 13:08:15.818138 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Type: application/json Jul 05 13:08:15.818138 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Host: 10.222.0.36 Jul 05 13:08:15.818138 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Openstack-System-Scope: None Jul 05 13:08:15.818138 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: User-Agent: python-urllib3/1.26.9 Jul 05 13:08:15.818138 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Auth-Token: gAAAAABixDYU4XKFSG1QuYBUfrOR6esVXAvVAGSwtVHPu7LBdH9y2w_YzZETCWfsRdlNKtdKF1ZnCITRlR9D6eRFZEIctYOdEIyordTrOjyt8lpzMH7MZZMgDMWMYkmZd-zLknVG2Gu6MRGRZNFw44v144fi7JGPzg5WSXfnQTVCEpw58mz6RK4 Jul 05 13:08:15.818138 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Id: None Jul 05 13:08:15.818138 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Name: None Jul 05 13:08:15.818138 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Identity-Status: Confirmed Jul 05 13:08:15.818138 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Is-Admin-Project: True Jul 05 13:08:15.818138 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Openstack-Nova-Api-Version: 2.20 Jul 05 13:08:15.818138 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Id: default Jul 05 13:08:15.818138 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Name: Default Jul 05 13:08:15.818138 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Id: 6c201d76ac4e4cc08fdc38e7165d4764 Jul 05 13:08:15.818138 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-32891023 Jul 05 13:08:15.818138 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Role: member,reader Jul 05 13:08:15.818138 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Roles: member,reader Jul 05 13:08:15.819846 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6c201d76ac4e4cc08fdc38e7165d4764"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6c201d76ac4e4cc08fdc38e7165d4764", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6c201d76ac4e4cc08fdc38e7165d4764"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6c201d76ac4e4cc08fdc38e7165d4764"}]}] Jul 05 13:08:15.819846 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant: tempest-AttachVolumeShelveTestJSON-32891023 Jul 05 13:08:15.819846 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Id: 6c201d76ac4e4cc08fdc38e7165d4764 Jul 05 13:08:15.819846 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-32891023 Jul 05 13:08:15.819846 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User: tempest-AttachVolumeShelveTestJSON-32891023-project Jul 05 13:08:15.819846 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Id: default Jul 05 13:08:15.819846 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Name: Default Jul 05 13:08:15.819846 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Id: 475bac060a98475d858e6181eec7ce11 Jul 05 13:08:15.819846 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Name: tempest-AttachVolumeShelveTestJSON-32891023-project Jul 05 13:08:15.819846 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: method: > Jul 05 13:08:15.819846 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: exception: Instance 42411ae1-103e-4934-9594-aaf06cc8a356 could not be found. Jul 05 13:08:15.819846 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: action_args: {'id': '42411ae1-103e-4934-9594-aaf06cc8a356'} Jul 05 13:08:15.820793 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 13:08:15.820793 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:08:15.820793 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 13:08:15.820793 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 13:08:15.820793 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 13:08:15.820793 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 13:08:15.820793 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 13:08:15.820793 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 13:08:15.820793 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 13:08:15.820793 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 13:08:15.820793 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42411ae1-103e-4934-9594-aaf06cc8a356 could not be found. Jul 05 13:08:15.820793 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:08:15.820793 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:08:15.820793 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:08:15.820793 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:08:15.820793 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:08:15.820793 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:08:15.820793 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 13:08:15.820793 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 13:08:15.820793 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 13:08:15.822481 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 13:08:15.822481 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 05 13:08:15.822481 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 05 13:08:15.822481 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 05 13:08:15.822481 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 05 13:08:15.822481 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 13:08:15.822481 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 13:08:15.822481 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 13:08:15.822481 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 13:08:15.822481 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42411ae1-103e-4934-9594-aaf06cc8a356 could not be found. Jul 05 13:08:15.822481 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:08:15.822481 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:08:15.822481 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:08:15.822481 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:08:15.822481 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:08:15.822481 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:08:15.822481 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 13:08:15.822481 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 13:08:15.822481 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42411ae1-103e-4934-9594-aaf06cc8a356 could not be found. Jul 05 13:08:15.822481 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:08:15.823937 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-6f9109ec-1330-41e8-a2f9-1a57bba122e1 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Returning 404 to user: Instance 42411ae1-103e-4934-9594-aaf06cc8a356 could not be found. {{(pid=118387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 13:08:15.823937 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-6f9109ec-1330-41e8-a2f9-1a57bba122e1 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "DELETE /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356" status: 404 len: 111 microversion: 2.20 time: 0.030301 Jul 05 13:08:15.823937 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 464/913] 10.222.0.36 () {60 vars in 1279 bytes} [Tue Jul 5 13:08:15 2022] DELETE /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 05 13:08:15.829048 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-022c1d5c-546c-4fca-ac12-36dafbef5727 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:08:15.829737 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-022c1d5c-546c-4fca-ac12-36dafbef5727 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 42411ae1-103e-4934-9594-aaf06cc8a356] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:08:15.835760 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-022c1d5c-546c-4fca-ac12-36dafbef5727 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:15.836195 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-022c1d5c-546c-4fca-ac12-36dafbef5727 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:15.836976 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-022c1d5c-546c-4fca-ac12-36dafbef5727 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:15.837401 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-022c1d5c-546c-4fca-ac12-36dafbef5727 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:15.850170 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.wsgi [None req-022c1d5c-546c-4fca-ac12-36dafbef5727 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] HTTP exception thrown: Instance 42411ae1-103e-4934-9594-aaf06cc8a356 could not be found. Jul 05 13:08:15.851743 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-022c1d5c-546c-4fca-ac12-36dafbef5727 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Request method failure captured: Jul 05 13:08:15.851743 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: request: GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356 HTTP/1.1 Jul 05 13:08:15.851743 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Accept: application/json Jul 05 13:08:15.851743 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Accept-Encoding: identity Jul 05 13:08:15.851743 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Connection: close Jul 05 13:08:15.851743 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Content-Length: 0 Jul 05 13:08:15.851743 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Content-Type: application/json Jul 05 13:08:15.851743 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Host: 10.222.0.36 Jul 05 13:08:15.851743 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Openstack-System-Scope: None Jul 05 13:08:15.851743 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: User-Agent: python-urllib3/1.26.9 Jul 05 13:08:15.851743 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Auth-Token: gAAAAABixDYU4XKFSG1QuYBUfrOR6esVXAvVAGSwtVHPu7LBdH9y2w_YzZETCWfsRdlNKtdKF1ZnCITRlR9D6eRFZEIctYOdEIyordTrOjyt8lpzMH7MZZMgDMWMYkmZd-zLknVG2Gu6MRGRZNFw44v144fi7JGPzg5WSXfnQTVCEpw58mz6RK4 Jul 05 13:08:15.851743 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Domain-Id: None Jul 05 13:08:15.851743 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Domain-Name: None Jul 05 13:08:15.851743 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Identity-Status: Confirmed Jul 05 13:08:15.851743 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Is-Admin-Project: True Jul 05 13:08:15.851743 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Openstack-Nova-Api-Version: 2.20 Jul 05 13:08:15.851743 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Domain-Id: default Jul 05 13:08:15.851743 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Domain-Name: Default Jul 05 13:08:15.851743 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Id: 6c201d76ac4e4cc08fdc38e7165d4764 Jul 05 13:08:15.851743 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-32891023 Jul 05 13:08:15.851743 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Role: member,reader Jul 05 13:08:15.851743 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Roles: member,reader Jul 05 13:08:15.853891 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6c201d76ac4e4cc08fdc38e7165d4764"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6c201d76ac4e4cc08fdc38e7165d4764", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6c201d76ac4e4cc08fdc38e7165d4764"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6c201d76ac4e4cc08fdc38e7165d4764"}]}] Jul 05 13:08:15.853891 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Tenant: tempest-AttachVolumeShelveTestJSON-32891023 Jul 05 13:08:15.853891 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Tenant-Id: 6c201d76ac4e4cc08fdc38e7165d4764 Jul 05 13:08:15.853891 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-32891023 Jul 05 13:08:15.853891 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User: tempest-AttachVolumeShelveTestJSON-32891023-project Jul 05 13:08:15.853891 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Domain-Id: default Jul 05 13:08:15.853891 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Domain-Name: Default Jul 05 13:08:15.853891 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Id: 475bac060a98475d858e6181eec7ce11 Jul 05 13:08:15.853891 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Name: tempest-AttachVolumeShelveTestJSON-32891023-project Jul 05 13:08:15.853891 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: method: > Jul 05 13:08:15.853891 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: exception: Instance 42411ae1-103e-4934-9594-aaf06cc8a356 could not be found. Jul 05 13:08:15.853891 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: action_args: {'id': '42411ae1-103e-4934-9594-aaf06cc8a356'} Jul 05 13:08:15.855008 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 13:08:15.855008 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:08:15.855008 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 13:08:15.855008 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 13:08:15.855008 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 13:08:15.855008 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 13:08:15.855008 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 13:08:15.855008 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 13:08:15.855008 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 13:08:15.855008 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 13:08:15.855008 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42411ae1-103e-4934-9594-aaf06cc8a356 could not be found. Jul 05 13:08:15.855008 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:08:15.855008 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:08:15.855008 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:08:15.855008 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:08:15.855008 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:08:15.855008 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:08:15.855008 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 13:08:15.855008 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 13:08:15.855008 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 13:08:15.856772 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 13:08:15.856772 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 13:08:15.856772 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 13:08:15.856772 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 13:08:15.856772 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 13:08:15.856772 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 13:08:15.856772 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 13:08:15.856772 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42411ae1-103e-4934-9594-aaf06cc8a356 could not be found. Jul 05 13:08:15.856772 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:08:15.856772 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:08:15.856772 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:08:15.856772 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:08:15.856772 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:08:15.856772 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:08:15.856772 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 13:08:15.856772 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 13:08:15.856772 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42411ae1-103e-4934-9594-aaf06cc8a356 could not be found. Jul 05 13:08:15.856772 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:08:15.867487 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-022c1d5c-546c-4fca-ac12-36dafbef5727 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Returning 404 to user: Instance 42411ae1-103e-4934-9594-aaf06cc8a356 could not be found. {{(pid=118386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 13:08:15.867487 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-022c1d5c-546c-4fca-ac12-36dafbef5727 tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356" status: 404 len: 111 microversion: 2.20 time: 0.029318 Jul 05 13:08:15.867487 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 450/914] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:08:15 2022] GET /compute/v2.1/servers/42411ae1-103e-4934-9594-aaf06cc8a356 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 05 13:08:17.226446 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-1c9f9eb1-48d1-4b7a-8c3b-b91645f5d95d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:08:17.226446 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-1c9f9eb1-48d1-4b7a-8c3b-b91645f5d95d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:08:17.232953 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1c9f9eb1-48d1-4b7a-8c3b-b91645f5d95d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:17.233409 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1c9f9eb1-48d1-4b7a-8c3b-b91645f5d95d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:17.234180 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1c9f9eb1-48d1-4b7a-8c3b-b91645f5d95d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:17.234626 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1c9f9eb1-48d1-4b7a-8c3b-b91645f5d95d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:17.247668 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.wsgi [None req-1c9f9eb1-48d1-4b7a-8c3b-b91645f5d95d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] HTTP exception thrown: Instance 72285b0b-7735-422b-b110-ef7b03fb367f could not be found. Jul 05 13:08:17.249369 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-1c9f9eb1-48d1-4b7a-8c3b-b91645f5d95d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Request method failure captured: Jul 05 13:08:17.249369 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: request: DELETE /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f HTTP/1.1 Jul 05 13:08:17.249369 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept: application/json Jul 05 13:08:17.249369 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept-Encoding: identity Jul 05 13:08:17.249369 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Connection: close Jul 05 13:08:17.249369 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Length: 0 Jul 05 13:08:17.249369 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Type: application/json Jul 05 13:08:17.249369 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Host: 10.222.0.36 Jul 05 13:08:17.249369 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Openstack-System-Scope: None Jul 05 13:08:17.249369 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: User-Agent: python-urllib3/1.26.9 Jul 05 13:08:17.249369 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Auth-Token: gAAAAABixDYU4XKFSG1QuYBUfrOR6esVXAvVAGSwtVHPu7LBdH9y2w_YzZETCWfsRdlNKtdKF1ZnCITRlR9D6eRFZEIctYOdEIyordTrOjyt8lpzMH7MZZMgDMWMYkmZd-zLknVG2Gu6MRGRZNFw44v144fi7JGPzg5WSXfnQTVCEpw58mz6RK4 Jul 05 13:08:17.249369 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Id: None Jul 05 13:08:17.249369 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Name: None Jul 05 13:08:17.249369 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Identity-Status: Confirmed Jul 05 13:08:17.249369 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Is-Admin-Project: True Jul 05 13:08:17.249369 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Openstack-Nova-Api-Version: 2.20 Jul 05 13:08:17.249369 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Id: default Jul 05 13:08:17.249369 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Name: Default Jul 05 13:08:17.249369 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Id: 6c201d76ac4e4cc08fdc38e7165d4764 Jul 05 13:08:17.249369 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-32891023 Jul 05 13:08:17.249369 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Role: member,reader Jul 05 13:08:17.249369 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Roles: member,reader Jul 05 13:08:17.251020 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6c201d76ac4e4cc08fdc38e7165d4764"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6c201d76ac4e4cc08fdc38e7165d4764", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6c201d76ac4e4cc08fdc38e7165d4764"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6c201d76ac4e4cc08fdc38e7165d4764"}]}] Jul 05 13:08:17.251020 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant: tempest-AttachVolumeShelveTestJSON-32891023 Jul 05 13:08:17.251020 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Id: 6c201d76ac4e4cc08fdc38e7165d4764 Jul 05 13:08:17.251020 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-32891023 Jul 05 13:08:17.251020 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User: tempest-AttachVolumeShelveTestJSON-32891023-project Jul 05 13:08:17.251020 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Id: default Jul 05 13:08:17.251020 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Name: Default Jul 05 13:08:17.251020 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Id: 475bac060a98475d858e6181eec7ce11 Jul 05 13:08:17.251020 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Name: tempest-AttachVolumeShelveTestJSON-32891023-project Jul 05 13:08:17.251020 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: method: > Jul 05 13:08:17.251020 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: exception: Instance 72285b0b-7735-422b-b110-ef7b03fb367f could not be found. Jul 05 13:08:17.251020 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: action_args: {'id': '72285b0b-7735-422b-b110-ef7b03fb367f'} Jul 05 13:08:17.251798 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 13:08:17.251798 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:08:17.251798 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 13:08:17.251798 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 13:08:17.251798 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 13:08:17.251798 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 13:08:17.251798 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 13:08:17.251798 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 13:08:17.251798 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 13:08:17.251798 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 13:08:17.251798 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72285b0b-7735-422b-b110-ef7b03fb367f could not be found. Jul 05 13:08:17.251798 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:08:17.251798 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:08:17.251798 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:08:17.251798 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:08:17.251798 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:08:17.251798 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:08:17.251798 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 13:08:17.251798 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 13:08:17.251798 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 13:08:17.253071 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 13:08:17.253071 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 05 13:08:17.253071 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 05 13:08:17.253071 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 05 13:08:17.253071 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 05 13:08:17.253071 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 13:08:17.253071 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 13:08:17.253071 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 13:08:17.253071 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 13:08:17.253071 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72285b0b-7735-422b-b110-ef7b03fb367f could not be found. Jul 05 13:08:17.253071 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:08:17.253071 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:08:17.253071 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:08:17.253071 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:08:17.253071 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:08:17.253071 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:08:17.253071 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 13:08:17.253071 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 13:08:17.253071 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72285b0b-7735-422b-b110-ef7b03fb367f could not be found. Jul 05 13:08:17.253071 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:08:17.254570 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-1c9f9eb1-48d1-4b7a-8c3b-b91645f5d95d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Returning 404 to user: Instance 72285b0b-7735-422b-b110-ef7b03fb367f could not be found. {{(pid=118387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 13:08:17.254570 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-1c9f9eb1-48d1-4b7a-8c3b-b91645f5d95d tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "DELETE /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 404 len: 111 microversion: 2.20 time: 0.028916 Jul 05 13:08:17.254570 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 465/915] 10.222.0.36 () {60 vars in 1279 bytes} [Tue Jul 5 13:08:17 2022] DELETE /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 05 13:08:17.259670 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-055158f4-7ac3-4231-b70b-28c1d984086c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:08:17.260281 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-055158f4-7ac3-4231-b70b-28c1d984086c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] [instance: 72285b0b-7735-422b-b110-ef7b03fb367f] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:08:17.266814 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-055158f4-7ac3-4231-b70b-28c1d984086c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:17.267268 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-055158f4-7ac3-4231-b70b-28c1d984086c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:17.268036 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-055158f4-7ac3-4231-b70b-28c1d984086c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:17.268470 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-055158f4-7ac3-4231-b70b-28c1d984086c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:17.282916 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.wsgi [None req-055158f4-7ac3-4231-b70b-28c1d984086c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] HTTP exception thrown: Instance 72285b0b-7735-422b-b110-ef7b03fb367f could not be found. Jul 05 13:08:17.284430 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-055158f4-7ac3-4231-b70b-28c1d984086c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Request method failure captured: Jul 05 13:08:17.284430 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: request: GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f HTTP/1.1 Jul 05 13:08:17.284430 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Accept: application/json Jul 05 13:08:17.284430 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Accept-Encoding: identity Jul 05 13:08:17.284430 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Connection: close Jul 05 13:08:17.284430 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Content-Length: 0 Jul 05 13:08:17.284430 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Content-Type: application/json Jul 05 13:08:17.284430 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Host: 10.222.0.36 Jul 05 13:08:17.284430 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Openstack-System-Scope: None Jul 05 13:08:17.284430 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: User-Agent: python-urllib3/1.26.9 Jul 05 13:08:17.284430 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Auth-Token: gAAAAABixDYU4XKFSG1QuYBUfrOR6esVXAvVAGSwtVHPu7LBdH9y2w_YzZETCWfsRdlNKtdKF1ZnCITRlR9D6eRFZEIctYOdEIyordTrOjyt8lpzMH7MZZMgDMWMYkmZd-zLknVG2Gu6MRGRZNFw44v144fi7JGPzg5WSXfnQTVCEpw58mz6RK4 Jul 05 13:08:17.284430 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Domain-Id: None Jul 05 13:08:17.284430 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Domain-Name: None Jul 05 13:08:17.284430 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Identity-Status: Confirmed Jul 05 13:08:17.284430 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Is-Admin-Project: True Jul 05 13:08:17.284430 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Openstack-Nova-Api-Version: 2.20 Jul 05 13:08:17.284430 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Domain-Id: default Jul 05 13:08:17.284430 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Domain-Name: Default Jul 05 13:08:17.284430 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Id: 6c201d76ac4e4cc08fdc38e7165d4764 Jul 05 13:08:17.284430 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-32891023 Jul 05 13:08:17.284430 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Role: member,reader Jul 05 13:08:17.284430 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Roles: member,reader Jul 05 13:08:17.286198 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6c201d76ac4e4cc08fdc38e7165d4764"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6c201d76ac4e4cc08fdc38e7165d4764", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6c201d76ac4e4cc08fdc38e7165d4764"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6c201d76ac4e4cc08fdc38e7165d4764"}]}] Jul 05 13:08:17.286198 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Tenant: tempest-AttachVolumeShelveTestJSON-32891023 Jul 05 13:08:17.286198 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Tenant-Id: 6c201d76ac4e4cc08fdc38e7165d4764 Jul 05 13:08:17.286198 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-32891023 Jul 05 13:08:17.286198 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User: tempest-AttachVolumeShelveTestJSON-32891023-project Jul 05 13:08:17.286198 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Domain-Id: default Jul 05 13:08:17.286198 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Domain-Name: Default Jul 05 13:08:17.286198 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Id: 475bac060a98475d858e6181eec7ce11 Jul 05 13:08:17.286198 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Name: tempest-AttachVolumeShelveTestJSON-32891023-project Jul 05 13:08:17.286198 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: method: > Jul 05 13:08:17.286198 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: exception: Instance 72285b0b-7735-422b-b110-ef7b03fb367f could not be found. Jul 05 13:08:17.286198 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: action_args: {'id': '72285b0b-7735-422b-b110-ef7b03fb367f'} Jul 05 13:08:17.287529 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 13:08:17.287529 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:08:17.287529 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 13:08:17.287529 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 13:08:17.287529 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 13:08:17.287529 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 13:08:17.287529 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 13:08:17.287529 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 13:08:17.287529 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 13:08:17.287529 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 13:08:17.287529 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72285b0b-7735-422b-b110-ef7b03fb367f could not be found. Jul 05 13:08:17.287529 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:08:17.287529 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:08:17.287529 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:08:17.287529 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:08:17.287529 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:08:17.287529 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:08:17.287529 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 13:08:17.287529 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 13:08:17.287529 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 13:08:17.289074 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 13:08:17.289074 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 13:08:17.289074 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 13:08:17.289074 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 13:08:17.289074 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 13:08:17.289074 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 13:08:17.289074 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 13:08:17.289074 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72285b0b-7735-422b-b110-ef7b03fb367f could not be found. Jul 05 13:08:17.289074 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:08:17.289074 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:08:17.289074 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:08:17.289074 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:08:17.289074 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:08:17.289074 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:08:17.289074 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 13:08:17.289074 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 13:08:17.289074 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72285b0b-7735-422b-b110-ef7b03fb367f could not be found. Jul 05 13:08:17.289074 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:08:17.290494 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-055158f4-7ac3-4231-b70b-28c1d984086c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] Returning 404 to user: Instance 72285b0b-7735-422b-b110-ef7b03fb367f could not be found. {{(pid=118386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 13:08:17.290494 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-055158f4-7ac3-4231-b70b-28c1d984086c tempest-AttachVolumeShelveTestJSON-32891023 tempest-AttachVolumeShelveTestJSON-32891023-project] 10.222.0.36 "GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f" status: 404 len: 111 microversion: 2.20 time: 0.030504 Jul 05 13:08:17.290494 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 451/916] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jul 5 13:08:17 2022] GET /compute/v2.1/servers/72285b0b-7735-422b-b110-ef7b03fb367f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 05 13:08:22.582160 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-c926ca14-151e-43d7-882f-7b74c5c83693 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:08:22.589626 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c926ca14-151e-43d7-882f-7b74c5c83693 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:22.590363 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c926ca14-151e-43d7-882f-7b74c5c83693 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:22.653719 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-c926ca14-151e-43d7-882f-7b74c5c83693 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Going to try to stop instance {{(pid=118387) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 05 13:08:22.929097 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-c926ca14-151e-43d7-882f-7b74c5c83693 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "POST /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25/action" status: 202 len: 0 microversion: 2.1 time: 0.350638 Jul 05 13:08:22.930665 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 466/917] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Jul 5 13:08:22 2022] POST /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25/action => generated 0 bytes in 352 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 13:08:22.938357 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-4369a323-85ce-400c-bb2c-265c2a4f4106 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:08:22.938964 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-4369a323-85ce-400c-bb2c-265c2a4f4106 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:08:22.952719 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-4369a323-85ce-400c-bb2c-265c2a4f4106 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:22.953175 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-4369a323-85ce-400c-bb2c-265c2a4f4106 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:22.953955 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-4369a323-85ce-400c-bb2c-265c2a4f4106 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:22.954392 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-4369a323-85ce-400c-bb2c-265c2a4f4106 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:23.103400 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-4369a323-85ce-400c-bb2c-265c2a4f4106 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:08:23.112876 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-4369a323-85ce-400c-bb2c-265c2a4f4106 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25" status: 200 len: 1721 microversion: 2.1 time: 0.178122 Jul 05 13:08:23.113632 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 452/918] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:08:22 2022] GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 => generated 1721 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:08:24.132155 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-a20fadf0-1100-473e-bc9d-46c7352bb536 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:08:24.133049 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-a20fadf0-1100-473e-bc9d-46c7352bb536 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:08:24.140310 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a20fadf0-1100-473e-bc9d-46c7352bb536 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:24.140905 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a20fadf0-1100-473e-bc9d-46c7352bb536 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:24.141880 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a20fadf0-1100-473e-bc9d-46c7352bb536 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:24.142322 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a20fadf0-1100-473e-bc9d-46c7352bb536 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:24.281720 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-a20fadf0-1100-473e-bc9d-46c7352bb536 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:08:24.289777 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-a20fadf0-1100-473e-bc9d-46c7352bb536 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25" status: 200 len: 1721 microversion: 2.1 time: 0.162626 Jul 05 13:08:24.290337 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 467/919] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:08:24 2022] GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:08:25.307808 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-69d981e9-70b5-4939-ba38-98172507e729 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:08:25.308544 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-69d981e9-70b5-4939-ba38-98172507e729 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:08:25.315599 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-69d981e9-70b5-4939-ba38-98172507e729 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:25.316052 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-69d981e9-70b5-4939-ba38-98172507e729 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:25.316945 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-69d981e9-70b5-4939-ba38-98172507e729 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:25.317340 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-69d981e9-70b5-4939-ba38-98172507e729 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:25.463012 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-69d981e9-70b5-4939-ba38-98172507e729 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:08:25.472158 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-69d981e9-70b5-4939-ba38-98172507e729 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25" status: 200 len: 1721 microversion: 2.1 time: 0.168723 Jul 05 13:08:25.472753 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 453/920] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:08:25 2022] GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:08:26.488773 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-47bbae26-9a0d-4019-ab6a-d4df416270c1 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:08:26.489358 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-47bbae26-9a0d-4019-ab6a-d4df416270c1 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:08:26.495959 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-47bbae26-9a0d-4019-ab6a-d4df416270c1 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:26.496739 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-47bbae26-9a0d-4019-ab6a-d4df416270c1 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:26.497522 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-47bbae26-9a0d-4019-ab6a-d4df416270c1 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:26.497955 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-47bbae26-9a0d-4019-ab6a-d4df416270c1 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:26.635503 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-47bbae26-9a0d-4019-ab6a-d4df416270c1 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:08:26.643481 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-47bbae26-9a0d-4019-ab6a-d4df416270c1 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25" status: 200 len: 1721 microversion: 2.1 time: 0.158456 Jul 05 13:08:26.644051 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 468/921] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:08:26 2022] GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:08:27.660450 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-3a529d9f-9c45-4fa0-ada3-3a6154ef29a0 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:08:27.661157 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-3a529d9f-9c45-4fa0-ada3-3a6154ef29a0 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:08:27.668025 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-3a529d9f-9c45-4fa0-ada3-3a6154ef29a0 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:27.668472 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-3a529d9f-9c45-4fa0-ada3-3a6154ef29a0 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:27.669262 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-3a529d9f-9c45-4fa0-ada3-3a6154ef29a0 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:27.669785 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-3a529d9f-9c45-4fa0-ada3-3a6154ef29a0 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:27.847897 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-3a529d9f-9c45-4fa0-ada3-3a6154ef29a0 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:08:27.859645 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-3a529d9f-9c45-4fa0-ada3-3a6154ef29a0 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25" status: 200 len: 1721 microversion: 2.1 time: 0.201297 Jul 05 13:08:27.859645 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 454/922] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:08:27 2022] GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 => generated 1721 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:08:28.875193 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-67e9a24e-adba-4876-b660-5127c8de178e tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:08:28.875809 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-67e9a24e-adba-4876-b660-5127c8de178e tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:08:28.882411 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-67e9a24e-adba-4876-b660-5127c8de178e tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:28.882855 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-67e9a24e-adba-4876-b660-5127c8de178e tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:28.883710 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-67e9a24e-adba-4876-b660-5127c8de178e tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:28.884178 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-67e9a24e-adba-4876-b660-5127c8de178e tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:29.163856 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-67e9a24e-adba-4876-b660-5127c8de178e tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:08:29.172871 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-67e9a24e-adba-4876-b660-5127c8de178e tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25" status: 200 len: 1721 microversion: 2.1 time: 0.301403 Jul 05 13:08:29.173451 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 469/923] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:08:28 2022] GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 => generated 1721 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:08:30.191062 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-b9465ef9-cc06-4a91-8ad6-7194cb13f19a tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:08:30.191734 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-b9465ef9-cc06-4a91-8ad6-7194cb13f19a tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:08:30.205500 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b9465ef9-cc06-4a91-8ad6-7194cb13f19a tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:30.205939 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b9465ef9-cc06-4a91-8ad6-7194cb13f19a tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:30.206711 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b9465ef9-cc06-4a91-8ad6-7194cb13f19a tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:30.207139 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b9465ef9-cc06-4a91-8ad6-7194cb13f19a tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:30.237252 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-1bd1ecbc-b184-41e7-b9b8-86bc49967ece tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:08:30.237934 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-1bd1ecbc-b184-41e7-b9b8-86bc49967ece tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] [instance: 58708391-4350-4b7e-8616-f3f3534bd2e6] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:08:30.244902 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1bd1ecbc-b184-41e7-b9b8-86bc49967ece tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:30.245543 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1bd1ecbc-b184-41e7-b9b8-86bc49967ece tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:30.246457 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1bd1ecbc-b184-41e7-b9b8-86bc49967ece tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:30.246755 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1bd1ecbc-b184-41e7-b9b8-86bc49967ece tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:30.290781 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-1bd1ecbc-b184-41e7-b9b8-86bc49967ece tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] [instance: 58708391-4350-4b7e-8616-f3f3534bd2e6] Going to try to terminate instance {{(pid=118387) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 13:08:30.385808 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-b9465ef9-cc06-4a91-8ad6-7194cb13f19a tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:08:30.394385 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-b9465ef9-cc06-4a91-8ad6-7194cb13f19a tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25" status: 200 len: 1721 microversion: 2.1 time: 0.208006 Jul 05 13:08:30.395067 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 455/924] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:08:30 2022] GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 => generated 1721 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:08:30.400524 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [req-ea0a84cf-734e-4a54-b813-a1b4fd0832d0 req-e2bb631d-8ebe-4b97-88ab-e2fcf6c80731 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58708391-4350-4b7e-8616-f3f3534bd2e6", "tag": "dea25a3b-1daa-482f-9f40-46b326121051"}]} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:08:30.408920 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-ea0a84cf-734e-4a54-b813-a1b4fd0832d0 req-e2bb631d-8ebe-4b97-88ab-e2fcf6c80731 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:30.409494 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-ea0a84cf-734e-4a54-b813-a1b4fd0832d0 req-e2bb631d-8ebe-4b97-88ab-e2fcf6c80731 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:30.421543 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.compute.server_external_events [req-ea0a84cf-734e-4a54-b813-a1b4fd0832d0 req-e2bb631d-8ebe-4b97-88ab-e2fcf6c80731 service nova] Creating event network-changed:dea25a3b-1daa-482f-9f40-46b326121051 for instance 58708391-4350-4b7e-8616-f3f3534bd2e6 on hv-cinder-79760 Jul 05 13:08:30.427047 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [req-ea0a84cf-734e-4a54-b813-a1b4fd0832d0 req-e2bb631d-8ebe-4b97-88ab-e2fcf6c80731 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030307 Jul 05 13:08:30.427837 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 456/925] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:08:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:08:30.631590 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-1bd1ecbc-b184-41e7-b9b8-86bc49967ece tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] 10.222.0.36 "DELETE /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6" status: 204 len: 0 microversion: 2.1 time: 0.397911 Jul 05 13:08:30.632450 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 470/926] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jul 5 13:08:30 2022] DELETE /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 05 13:08:30.647793 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-ca9473af-9028-405d-a4e7-8f044e0f3d0c tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:08:30.649008 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-ca9473af-9028-405d-a4e7-8f044e0f3d0c tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] [instance: 58708391-4350-4b7e-8616-f3f3534bd2e6] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:08:30.660940 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ca9473af-9028-405d-a4e7-8f044e0f3d0c tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:30.661467 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ca9473af-9028-405d-a4e7-8f044e0f3d0c tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:30.662182 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ca9473af-9028-405d-a4e7-8f044e0f3d0c tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:30.662604 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ca9473af-9028-405d-a4e7-8f044e0f3d0c tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:30.828533 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-ca9473af-9028-405d-a4e7-8f044e0f3d0c tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf000835f1f48cca0a46b233e52c8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec699c3dd1ab470c8cc0685e6e9f766a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:08:30.836555 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-ca9473af-9028-405d-a4e7-8f044e0f3d0c tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] 10.222.0.36 "GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6" status: 200 len: 1569 microversion: 2.1 time: 0.193342 Jul 05 13:08:30.837141 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 457/927] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:08:30 2022] GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6 => generated 1569 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:08:31.414012 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-4d64a6be-68cf-44d2-86df-69edf8190699 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:08:31.414801 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-4d64a6be-68cf-44d2-86df-69edf8190699 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:08:31.422147 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4d64a6be-68cf-44d2-86df-69edf8190699 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:31.422680 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4d64a6be-68cf-44d2-86df-69edf8190699 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:31.423590 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4d64a6be-68cf-44d2-86df-69edf8190699 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:31.424264 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4d64a6be-68cf-44d2-86df-69edf8190699 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:31.564132 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-4d64a6be-68cf-44d2-86df-69edf8190699 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:08:31.572764 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-4d64a6be-68cf-44d2-86df-69edf8190699 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25" status: 200 len: 1721 microversion: 2.1 time: 0.162543 Jul 05 13:08:31.573266 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 471/928] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:08:31 2022] GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:08:31.854701 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-3d77633d-ceab-4e6f-8438-705cc35cd58a tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:08:31.855236 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-3d77633d-ceab-4e6f-8438-705cc35cd58a tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] [instance: 58708391-4350-4b7e-8616-f3f3534bd2e6] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:08:31.861965 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-3d77633d-ceab-4e6f-8438-705cc35cd58a tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:31.862414 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-3d77633d-ceab-4e6f-8438-705cc35cd58a tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:31.863169 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-3d77633d-ceab-4e6f-8438-705cc35cd58a tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:31.863603 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-3d77633d-ceab-4e6f-8438-705cc35cd58a tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:31.998290 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-3d77633d-ceab-4e6f-8438-705cc35cd58a tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf000835f1f48cca0a46b233e52c8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec699c3dd1ab470c8cc0685e6e9f766a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:08:32.005757 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-3d77633d-ceab-4e6f-8438-705cc35cd58a tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] 10.222.0.36 "GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6" status: 200 len: 1569 microversion: 2.1 time: 0.154996 Jul 05 13:08:32.006320 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 458/929] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:08:31 2022] GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:08:32.499111 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-f2bcef92-96a9-442e-8e96-7fc8b8b82610 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2057154801", "imageRef": "d6134305-a5c0-4d2c-afc8-e54be21f685c", "flavorRef": "452", "networks": [{"uuid": "af4d3eea-1fc4-4fc6-8454-b9bde8c6c614"}]}} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:08:32.553753 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.network.neutron [None req-f2bcef92-96a9-442e-8e96-7fc8b8b82610 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] validate_networks() for [('af4d3eea-1fc4-4fc6-8454-b9bde8c6c614', None, None, None, None, None)] {{(pid=118387) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 13:08:32.590031 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-6fe04d2e-650b-43b5-a3bf-8aea8674ca13 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:08:32.590653 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-6fe04d2e-650b-43b5-a3bf-8aea8674ca13 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:08:32.596783 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-6fe04d2e-650b-43b5-a3bf-8aea8674ca13 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:32.597231 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-6fe04d2e-650b-43b5-a3bf-8aea8674ca13 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:32.598000 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-6fe04d2e-650b-43b5-a3bf-8aea8674ca13 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:32.598432 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-6fe04d2e-650b-43b5-a3bf-8aea8674ca13 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:32.804016 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-6fe04d2e-650b-43b5-a3bf-8aea8674ca13 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:08:32.813873 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-6fe04d2e-650b-43b5-a3bf-8aea8674ca13 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25" status: 200 len: 1721 microversion: 2.1 time: 0.227787 Jul 05 13:08:32.814696 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 459/930] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:08:32 2022] GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 => generated 1721 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:08:33.023353 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-17f9013c-3186-48ce-b467-24f124b106b5 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:08:33.024039 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-17f9013c-3186-48ce-b467-24f124b106b5 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] [instance: 58708391-4350-4b7e-8616-f3f3534bd2e6] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:08:33.030835 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-17f9013c-3186-48ce-b467-24f124b106b5 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:33.031282 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-17f9013c-3186-48ce-b467-24f124b106b5 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:33.032077 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-17f9013c-3186-48ce-b467-24f124b106b5 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:33.032510 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-17f9013c-3186-48ce-b467-24f124b106b5 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:33.143460 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-f2bcef92-96a9-442e-8e96-7fc8b8b82610 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Flavor limits 0:0:0 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 13:08:33.143923 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-f2bcef92-96a9-442e-8e96-7fc8b8b82610 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Image limits 0:0:0 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 13:08:33.144453 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-f2bcef92-96a9-442e-8e96-7fc8b8b82610 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Flavor pref 0:0:0 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 13:08:33.144894 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-f2bcef92-96a9-442e-8e96-7fc8b8b82610 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Image pref 0:0:0 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 13:08:33.145310 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-f2bcef92-96a9-442e-8e96-7fc8b8b82610 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 13:08:33.163540 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f2bcef92-96a9-442e-8e96-7fc8b8b82610 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:33.163999 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f2bcef92-96a9-442e-8e96-7fc8b8b82610 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:33.164836 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f2bcef92-96a9-442e-8e96-7fc8b8b82610 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:33.165286 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f2bcef92-96a9-442e-8e96-7fc8b8b82610 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:33.184562 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.quota [None req-f2bcef92-96a9-442e-8e96-7fc8b8b82610 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Getting quotas for project 8461fdd34eef42d089eb3c3d7d607518. Resources: {'instances', 'cores', 'ram'} {{(pid=118387) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 13:08:33.191894 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.quota [None req-f2bcef92-96a9-442e-8e96-7fc8b8b82610 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Getting quotas for user 3212553bb4ae401d9d56f311c779f035 and project 8461fdd34eef42d089eb3c3d7d607518. Resources: {'instances', 'cores', 'ram'} {{(pid=118387) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 13:08:33.194847 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-17f9013c-3186-48ce-b467-24f124b106b5 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf000835f1f48cca0a46b233e52c8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec699c3dd1ab470c8cc0685e6e9f766a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:08:33.203395 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-17f9013c-3186-48ce-b467-24f124b106b5 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] 10.222.0.36 "GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6" status: 200 len: 1450 microversion: 2.1 time: 0.183937 Jul 05 13:08:33.207403 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 460/931] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:08:33 2022] GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6 => generated 1450 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:08:33.209292 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-f2bcef92-96a9-442e-8e96-7fc8b8b82610 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Going to run 1 instances... {{(pid=118387) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 13:08:33.211584 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-f2bcef92-96a9-442e-8e96-7fc8b8b82610 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] [instance: 8c95e965-abb1-4111-a239-63f7a4a2c05c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d6134305-a5c0-4d2c-afc8-e54be21f685c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118387) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 13:08:33.235951 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [req-e91310c5-0171-40e5-860d-0429a17c522c req-cab64dfa-a196-476c-bb1b-4ea78e8484f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58708391-4350-4b7e-8616-f3f3534bd2e6", "name": "network-vif-deleted", "tag": "dea25a3b-1daa-482f-9f40-46b326121051"}]} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:08:33.245486 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-e91310c5-0171-40e5-860d-0429a17c522c req-cab64dfa-a196-476c-bb1b-4ea78e8484f2 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:33.245933 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-e91310c5-0171-40e5-860d-0429a17c522c req-cab64dfa-a196-476c-bb1b-4ea78e8484f2 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:33.256936 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.compute.server_external_events [req-e91310c5-0171-40e5-860d-0429a17c522c req-cab64dfa-a196-476c-bb1b-4ea78e8484f2 service nova] Creating event network-vif-deleted:dea25a3b-1daa-482f-9f40-46b326121051 for instance 58708391-4350-4b7e-8616-f3f3534bd2e6 on hv-cinder-79760 Jul 05 13:08:33.262096 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [req-e91310c5-0171-40e5-860d-0429a17c522c req-cab64dfa-a196-476c-bb1b-4ea78e8484f2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030244 Jul 05 13:08:33.262992 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 461/932] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:08:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 13:08:33.336569 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f2bcef92-96a9-442e-8e96-7fc8b8b82610 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] [610652a8-5b06-45b1-9f1a-18a4beac78d4] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 05 13:08:33.831832 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-70772c13-bbcc-40b0-945a-2ba1c019cd2d tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:08:33.832530 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-70772c13-bbcc-40b0-945a-2ba1c019cd2d tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:08:33.839493 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-70772c13-bbcc-40b0-945a-2ba1c019cd2d tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:33.839952 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-70772c13-bbcc-40b0-945a-2ba1c019cd2d tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:33.840725 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-70772c13-bbcc-40b0-945a-2ba1c019cd2d tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:33.841158 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-70772c13-bbcc-40b0-945a-2ba1c019cd2d tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:33.845280 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:33.971424 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-70772c13-bbcc-40b0-945a-2ba1c019cd2d tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:08:33.979168 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-70772c13-bbcc-40b0-945a-2ba1c019cd2d tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25" status: 200 len: 1721 microversion: 2.1 time: 0.151688 Jul 05 13:08:33.979937 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 462/933] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:08:33 2022] GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:08:34.221277 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-eb7895ad-a305-4ad6-bb51-2e72246411f8 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:08:34.221953 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-eb7895ad-a305-4ad6-bb51-2e72246411f8 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] [instance: 58708391-4350-4b7e-8616-f3f3534bd2e6] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:08:34.229082 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-eb7895ad-a305-4ad6-bb51-2e72246411f8 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:34.229534 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-eb7895ad-a305-4ad6-bb51-2e72246411f8 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:34.230300 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-eb7895ad-a305-4ad6-bb51-2e72246411f8 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:34.230975 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-eb7895ad-a305-4ad6-bb51-2e72246411f8 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:34.296101 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-eb7895ad-a305-4ad6-bb51-2e72246411f8 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf000835f1f48cca0a46b233e52c8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec699c3dd1ab470c8cc0685e6e9f766a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:08:34.303731 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-eb7895ad-a305-4ad6-bb51-2e72246411f8 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] 10.222.0.36 "GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6" status: 200 len: 1219 microversion: 2.1 time: 0.086718 Jul 05 13:08:34.304313 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 463/934] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:08:34 2022] GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:08:34.343995 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO oslo.messaging._drivers.impl_rabbit [None req-f2bcef92-96a9-442e-8e96-7fc8b8b82610 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] [610652a8-5b06-45b1-9f1a-18a4beac78d4] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 41000. Jul 05 13:08:34.348265 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-f2bcef92-96a9-442e-8e96-7fc8b8b82610 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.853146 Jul 05 13:08:34.348948 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 472/935] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jul 5 13:08:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1855 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 05 13:08:34.359520 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-107d3bef-ed6a-4fb1-b153-f423aaad2920 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:08:34.360162 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-107d3bef-ed6a-4fb1-b153-f423aaad2920 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] [instance: 8c95e965-abb1-4111-a239-63f7a4a2c05c] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:08:34.413402 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-107d3bef-ed6a-4fb1-b153-f423aaad2920 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3212553bb4ae401d9d56f311c779f035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8461fdd34eef42d089eb3c3d7d607518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:08:34.420930 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-107d3bef-ed6a-4fb1-b153-f423aaad2920 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] 10.222.0.36 "GET /compute/v2.1/servers/8c95e965-abb1-4111-a239-63f7a4a2c05c" status: 200 len: 1219 microversion: 2.1 time: 0.065444 Jul 05 13:08:34.421499 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 464/936] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:08:34 2022] GET /compute/v2.1/servers/8c95e965-abb1-4111-a239-63f7a4a2c05c => generated 1219 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:08:34.997869 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-8894ffed-9397-4f13-bb1a-0dc64bb15f1c tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:08:34.998586 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-8894ffed-9397-4f13-bb1a-0dc64bb15f1c tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:08:35.008321 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8894ffed-9397-4f13-bb1a-0dc64bb15f1c tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:35.008928 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8894ffed-9397-4f13-bb1a-0dc64bb15f1c tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:35.009791 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8894ffed-9397-4f13-bb1a-0dc64bb15f1c tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:35.010290 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8894ffed-9397-4f13-bb1a-0dc64bb15f1c tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:35.144618 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-8894ffed-9397-4f13-bb1a-0dc64bb15f1c tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:08:35.153010 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-8894ffed-9397-4f13-bb1a-0dc64bb15f1c tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25" status: 200 len: 1721 microversion: 2.1 time: 0.160257 Jul 05 13:08:35.153588 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 473/937] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:08:34 2022] GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:08:35.320759 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-1a628fb4-e4e2-47ee-9221-d5fe998b858f tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:08:35.321455 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-1a628fb4-e4e2-47ee-9221-d5fe998b858f tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] [instance: 58708391-4350-4b7e-8616-f3f3534bd2e6] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:08:35.328294 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-1a628fb4-e4e2-47ee-9221-d5fe998b858f tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:35.328776 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-1a628fb4-e4e2-47ee-9221-d5fe998b858f tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:35.329536 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-1a628fb4-e4e2-47ee-9221-d5fe998b858f tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:35.329967 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-1a628fb4-e4e2-47ee-9221-d5fe998b858f tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:35.343671 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.wsgi [None req-1a628fb4-e4e2-47ee-9221-d5fe998b858f tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] HTTP exception thrown: Instance 58708391-4350-4b7e-8616-f3f3534bd2e6 could not be found. Jul 05 13:08:35.345348 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-1a628fb4-e4e2-47ee-9221-d5fe998b858f tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Request method failure captured: Jul 05 13:08:35.345348 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: request: GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6 HTTP/1.1 Jul 05 13:08:35.345348 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Accept: application/json Jul 05 13:08:35.345348 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Accept-Encoding: identity Jul 05 13:08:35.345348 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Connection: close Jul 05 13:08:35.345348 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Content-Length: 0 Jul 05 13:08:35.345348 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Content-Type: application/json Jul 05 13:08:35.345348 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Host: 10.222.0.36 Jul 05 13:08:35.345348 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Openstack-System-Scope: None Jul 05 13:08:35.345348 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: User-Agent: python-urllib3/1.26.9 Jul 05 13:08:35.345348 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Auth-Token: gAAAAABixDaWjp7VlO_KfOAZAazJgTpKY-hWKRsWg_crIdKBxZIJYlTZOBRfgInce195opxrSoKxd-5KfX8ke9pMEfOvnIbo8jOAjkRVnE12l8Y2pB0ncrgTQQgvIXTPi2hoEsprgyG1eLVUKGMlym7VYM-GgeS08_6fgBnciq-7GWzVQzAuYQo Jul 05 13:08:35.345348 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Domain-Id: None Jul 05 13:08:35.345348 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Domain-Name: None Jul 05 13:08:35.345348 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Identity-Status: Confirmed Jul 05 13:08:35.345348 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Is-Admin-Project: True Jul 05 13:08:35.345348 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Domain-Id: default Jul 05 13:08:35.345348 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Domain-Name: Default Jul 05 13:08:35.345348 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Id: ec699c3dd1ab470c8cc0685e6e9f766a Jul 05 13:08:35.345348 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Name: tempest-TestShelveInstance-1650648592 Jul 05 13:08:35.345348 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Role: member,reader Jul 05 13:08:35.345348 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Roles: member,reader Jul 05 13:08:35.346914 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ec699c3dd1ab470c8cc0685e6e9f766a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ec699c3dd1ab470c8cc0685e6e9f766a", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ec699c3dd1ab470c8cc0685e6e9f766a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ec699c3dd1ab470c8cc0685e6e9f766a"}]}] Jul 05 13:08:35.346914 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Tenant: tempest-TestShelveInstance-1650648592 Jul 05 13:08:35.346914 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Tenant-Id: ec699c3dd1ab470c8cc0685e6e9f766a Jul 05 13:08:35.346914 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Tenant-Name: tempest-TestShelveInstance-1650648592 Jul 05 13:08:35.346914 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User: tempest-TestShelveInstance-1650648592-project Jul 05 13:08:35.346914 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Domain-Id: default Jul 05 13:08:35.346914 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Domain-Name: Default Jul 05 13:08:35.346914 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Id: 4cf000835f1f48cca0a46b233e52c8b9 Jul 05 13:08:35.346914 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Name: tempest-TestShelveInstance-1650648592-project Jul 05 13:08:35.346914 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: method: > Jul 05 13:08:35.346914 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: exception: Instance 58708391-4350-4b7e-8616-f3f3534bd2e6 could not be found. Jul 05 13:08:35.346914 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: action_args: {'id': '58708391-4350-4b7e-8616-f3f3534bd2e6'} Jul 05 13:08:35.347751 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 13:08:35.347751 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:08:35.347751 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 13:08:35.347751 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 13:08:35.347751 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 13:08:35.347751 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 13:08:35.347751 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 13:08:35.347751 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 13:08:35.347751 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 13:08:35.347751 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 13:08:35.347751 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58708391-4350-4b7e-8616-f3f3534bd2e6 could not be found. Jul 05 13:08:35.347751 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:08:35.347751 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:08:35.347751 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:08:35.347751 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:08:35.347751 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:08:35.347751 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:08:35.347751 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 13:08:35.347751 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 13:08:35.347751 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 13:08:35.349113 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 13:08:35.349113 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 13:08:35.349113 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 13:08:35.349113 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 13:08:35.349113 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 13:08:35.349113 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 13:08:35.349113 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 13:08:35.349113 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58708391-4350-4b7e-8616-f3f3534bd2e6 could not be found. Jul 05 13:08:35.349113 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:08:35.349113 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:08:35.349113 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:08:35.349113 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:08:35.349113 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:08:35.349113 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:08:35.349113 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 13:08:35.349113 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 13:08:35.349113 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58708391-4350-4b7e-8616-f3f3534bd2e6 could not be found. Jul 05 13:08:35.349113 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:08:35.350300 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-1a628fb4-e4e2-47ee-9221-d5fe998b858f tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Returning 404 to user: Instance 58708391-4350-4b7e-8616-f3f3534bd2e6 could not be found. {{(pid=118386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 13:08:35.350300 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-1a628fb4-e4e2-47ee-9221-d5fe998b858f tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] 10.222.0.36 "GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6" status: 404 len: 111 microversion: 2.1 time: 0.029901 Jul 05 13:08:35.350300 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 465/938] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:08:35 2022] GET /compute/v2.1/servers/58708391-4350-4b7e-8616-f3f3534bd2e6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 13:08:35.438060 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-e23b9165-5715-494e-8848-e76b1bfc9c4e tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:08:35.438872 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-e23b9165-5715-494e-8848-e76b1bfc9c4e tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] [instance: 8c95e965-abb1-4111-a239-63f7a4a2c05c] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:08:35.496379 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-e23b9165-5715-494e-8848-e76b1bfc9c4e tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3212553bb4ae401d9d56f311c779f035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8461fdd34eef42d089eb3c3d7d607518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:08:35.504888 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-e23b9165-5715-494e-8848-e76b1bfc9c4e tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] 10.222.0.36 "GET /compute/v2.1/servers/8c95e965-abb1-4111-a239-63f7a4a2c05c" status: 200 len: 1219 microversion: 2.1 time: 0.070812 Jul 05 13:08:35.505797 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 474/939] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:08:35 2022] GET /compute/v2.1/servers/8c95e965-abb1-4111-a239-63f7a4a2c05c => generated 1219 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:08:35.674859 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-ff5a3f92-a3ac-4fe3-8653-fc87927e9a45 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] Calling method '.version_select at 0x7f70de626790>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:08:35.824724 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-ff5a3f92-a3ac-4fe3-8653-fc87927e9a45 tempest-TestShelveInstance-1650648592 tempest-TestShelveInstance-1650648592-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-162669083" status: 202 len: 0 microversion: 2.1 time: 0.154581 Jul 05 13:08:35.825372 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 466/940] 10.222.0.36 () {58 vars in 1250 bytes} [Tue Jul 5 13:08:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-162669083 => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 13:08:36.172148 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-0371ab96-6f4e-445c-bbab-f938be0a4c80 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:08:36.172727 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-0371ab96-6f4e-445c-bbab-f938be0a4c80 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:08:36.180660 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0371ab96-6f4e-445c-bbab-f938be0a4c80 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:36.181173 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0371ab96-6f4e-445c-bbab-f938be0a4c80 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:36.182008 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0371ab96-6f4e-445c-bbab-f938be0a4c80 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:36.182515 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0371ab96-6f4e-445c-bbab-f938be0a4c80 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:36.319056 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-0371ab96-6f4e-445c-bbab-f938be0a4c80 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:08:36.329053 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-0371ab96-6f4e-445c-bbab-f938be0a4c80 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25" status: 200 len: 1721 microversion: 2.1 time: 0.161679 Jul 05 13:08:36.329750 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 475/941] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:08:36 2022] GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:08:36.522668 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-f2534571-d3a0-40a8-a867-3a25c4abb67d tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:08:36.523402 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-f2534571-d3a0-40a8-a867-3a25c4abb67d tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] [instance: 8c95e965-abb1-4111-a239-63f7a4a2c05c] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:08:36.532624 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f2534571-d3a0-40a8-a867-3a25c4abb67d tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:36.534319 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f2534571-d3a0-40a8-a867-3a25c4abb67d tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:36.534319 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f2534571-d3a0-40a8-a867-3a25c4abb67d tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:36.534319 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f2534571-d3a0-40a8-a867-3a25c4abb67d tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:36.597974 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-f2534571-d3a0-40a8-a867-3a25c4abb67d tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3212553bb4ae401d9d56f311c779f035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8461fdd34eef42d089eb3c3d7d607518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:08:36.605599 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-f2534571-d3a0-40a8-a867-3a25c4abb67d tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] 10.222.0.36 "GET /compute/v2.1/servers/8c95e965-abb1-4111-a239-63f7a4a2c05c" status: 200 len: 1271 microversion: 2.1 time: 0.087491 Jul 05 13:08:36.606732 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 467/942] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:08:36 2022] GET /compute/v2.1/servers/8c95e965-abb1-4111-a239-63f7a4a2c05c => generated 1271 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:08:37.347521 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-736380f9-cd53-4c0e-9e4b-455b21b991c9 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:08:37.348196 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-736380f9-cd53-4c0e-9e4b-455b21b991c9 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:08:37.354983 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-736380f9-cd53-4c0e-9e4b-455b21b991c9 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:37.355538 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-736380f9-cd53-4c0e-9e4b-455b21b991c9 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:37.356661 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-736380f9-cd53-4c0e-9e4b-455b21b991c9 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:37.357163 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-736380f9-cd53-4c0e-9e4b-455b21b991c9 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:37.361293 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:37.491538 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-736380f9-cd53-4c0e-9e4b-455b21b991c9 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:08:37.499642 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-736380f9-cd53-4c0e-9e4b-455b21b991c9 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25" status: 200 len: 1721 microversion: 2.1 time: 0.156418 Jul 05 13:08:37.500203 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 476/943] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:08:37 2022] GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:08:37.623987 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-964ba53f-c777-482e-8d79-5fa21a7751b6 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:08:37.624611 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-964ba53f-c777-482e-8d79-5fa21a7751b6 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] [instance: 8c95e965-abb1-4111-a239-63f7a4a2c05c] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:08:37.631237 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-964ba53f-c777-482e-8d79-5fa21a7751b6 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:37.631723 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-964ba53f-c777-482e-8d79-5fa21a7751b6 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:37.632481 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-964ba53f-c777-482e-8d79-5fa21a7751b6 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:37.632929 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-964ba53f-c777-482e-8d79-5fa21a7751b6 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:37.695734 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-964ba53f-c777-482e-8d79-5fa21a7751b6 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3212553bb4ae401d9d56f311c779f035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8461fdd34eef42d089eb3c3d7d607518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:08:37.704000 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-964ba53f-c777-482e-8d79-5fa21a7751b6 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] 10.222.0.36 "GET /compute/v2.1/servers/8c95e965-abb1-4111-a239-63f7a4a2c05c" status: 200 len: 1277 microversion: 2.1 time: 0.084409 Jul 05 13:08:37.704608 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 468/944] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:08:37 2022] GET /compute/v2.1/servers/8c95e965-abb1-4111-a239-63f7a4a2c05c => generated 1277 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:08:38.518171 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-f244d5d6-4306-4afa-b909-64f24824f286 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:08:38.519061 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-f244d5d6-4306-4afa-b909-64f24824f286 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:08:38.527413 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f244d5d6-4306-4afa-b909-64f24824f286 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:38.527996 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f244d5d6-4306-4afa-b909-64f24824f286 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:38.528927 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f244d5d6-4306-4afa-b909-64f24824f286 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:38.530040 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f244d5d6-4306-4afa-b909-64f24824f286 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:38.721963 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-38b5f9b8-57cc-43e1-98d1-cc6787fc8a4b tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:08:38.723049 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-38b5f9b8-57cc-43e1-98d1-cc6787fc8a4b tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] [instance: 8c95e965-abb1-4111-a239-63f7a4a2c05c] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:08:38.726028 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:38.732717 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-38b5f9b8-57cc-43e1-98d1-cc6787fc8a4b tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:38.733162 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-38b5f9b8-57cc-43e1-98d1-cc6787fc8a4b tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:38.734137 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-38b5f9b8-57cc-43e1-98d1-cc6787fc8a4b tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:38.734580 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-38b5f9b8-57cc-43e1-98d1-cc6787fc8a4b tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:38.790665 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-f244d5d6-4306-4afa-b909-64f24824f286 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:08:38.800569 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-f244d5d6-4306-4afa-b909-64f24824f286 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25" status: 200 len: 1721 microversion: 2.1 time: 0.285798 Jul 05 13:08:38.800797 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 477/945] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:08:38 2022] GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 => generated 1721 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:08:38.933079 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-38b5f9b8-57cc-43e1-98d1-cc6787fc8a4b tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3212553bb4ae401d9d56f311c779f035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8461fdd34eef42d089eb3c3d7d607518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:08:38.940736 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-38b5f9b8-57cc-43e1-98d1-cc6787fc8a4b tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] 10.222.0.36 "GET /compute/v2.1/servers/8c95e965-abb1-4111-a239-63f7a4a2c05c" status: 200 len: 1319 microversion: 2.1 time: 0.222915 Jul 05 13:08:38.941521 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 469/946] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:08:38 2022] GET /compute/v2.1/servers/8c95e965-abb1-4111-a239-63f7a4a2c05c => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:08:39.206211 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-68c5d57d-a5ea-4c25-94a2-65075be33edd req-a934cfe9-b8df-4cf0-9a81-daedc0b9362c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c95e965-abb1-4111-a239-63f7a4a2c05c", "tag": "563fa8b1-1ab2-40f4-8eef-a4f69de63ad8"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:08:39.210104 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_api:SELECT=62,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:39.216295 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-68c5d57d-a5ea-4c25-94a2-65075be33edd req-a934cfe9-b8df-4cf0-9a81-daedc0b9362c service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:39.216807 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-68c5d57d-a5ea-4c25-94a2-65075be33edd req-a934cfe9-b8df-4cf0-9a81-daedc0b9362c service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:39.228802 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-68c5d57d-a5ea-4c25-94a2-65075be33edd req-a934cfe9-b8df-4cf0-9a81-daedc0b9362c service nova] Creating event network-changed:563fa8b1-1ab2-40f4-8eef-a4f69de63ad8 for instance 8c95e965-abb1-4111-a239-63f7a4a2c05c on hv-cinder-79760 Jul 05 13:08:39.234186 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-68c5d57d-a5ea-4c25-94a2-65075be33edd req-a934cfe9-b8df-4cf0-9a81-daedc0b9362c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032626 Jul 05 13:08:39.235397 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 478/947] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:08:39.817590 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-9153394f-16b3-4639-a4b4-80953d314276 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:08:39.818332 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-9153394f-16b3-4639-a4b4-80953d314276 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:08:39.829117 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-9153394f-16b3-4639-a4b4-80953d314276 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:39.830253 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-9153394f-16b3-4639-a4b4-80953d314276 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:39.832691 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-9153394f-16b3-4639-a4b4-80953d314276 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:39.832691 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-9153394f-16b3-4639-a4b4-80953d314276 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:39.958746 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-ff472392-3fff-45d5-a2e3-e25bda01c450 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:08:39.959542 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-ff472392-3fff-45d5-a2e3-e25bda01c450 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] [instance: 8c95e965-abb1-4111-a239-63f7a4a2c05c] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:08:39.966895 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ff472392-3fff-45d5-a2e3-e25bda01c450 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:39.967477 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ff472392-3fff-45d5-a2e3-e25bda01c450 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:39.968430 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ff472392-3fff-45d5-a2e3-e25bda01c450 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:39.973713 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ff472392-3fff-45d5-a2e3-e25bda01c450 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:40.051920 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-9153394f-16b3-4639-a4b4-80953d314276 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:08:40.061134 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-9153394f-16b3-4639-a4b4-80953d314276 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25" status: 200 len: 1721 microversion: 2.1 time: 0.248519 Jul 05 13:08:40.065695 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 470/948] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:08:39 2022] GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 => generated 1721 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:08:40.150504 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-ff472392-3fff-45d5-a2e3-e25bda01c450 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3212553bb4ae401d9d56f311c779f035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8461fdd34eef42d089eb3c3d7d607518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:08:40.158481 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-ff472392-3fff-45d5-a2e3-e25bda01c450 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] 10.222.0.36 "GET /compute/v2.1/servers/8c95e965-abb1-4111-a239-63f7a4a2c05c" status: 200 len: 1319 microversion: 2.1 time: 0.205102 Jul 05 13:08:40.159085 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 479/949] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:08:39 2022] GET /compute/v2.1/servers/8c95e965-abb1-4111-a239-63f7a4a2c05c => generated 1319 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:08:41.082431 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-a7b6b2f6-6f9e-4f58-b957-1f9555a078e6 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:08:41.083393 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-a7b6b2f6-6f9e-4f58-b957-1f9555a078e6 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:08:41.090842 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a7b6b2f6-6f9e-4f58-b957-1f9555a078e6 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:41.091557 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a7b6b2f6-6f9e-4f58-b957-1f9555a078e6 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:41.092318 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a7b6b2f6-6f9e-4f58-b957-1f9555a078e6 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:41.092948 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a7b6b2f6-6f9e-4f58-b957-1f9555a078e6 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:41.180157 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-4de69770-45f1-4d29-b613-a85fc2a3cf6f tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:08:41.185690 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-4de69770-45f1-4d29-b613-a85fc2a3cf6f tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] [instance: 8c95e965-abb1-4111-a239-63f7a4a2c05c] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:08:41.197658 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4de69770-45f1-4d29-b613-a85fc2a3cf6f tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:41.198121 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4de69770-45f1-4d29-b613-a85fc2a3cf6f tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:41.198905 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4de69770-45f1-4d29-b613-a85fc2a3cf6f tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:41.199338 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4de69770-45f1-4d29-b613-a85fc2a3cf6f tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:41.343517 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-a7b6b2f6-6f9e-4f58-b957-1f9555a078e6 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:08:41.375291 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-a7b6b2f6-6f9e-4f58-b957-1f9555a078e6 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25" status: 200 len: 1721 microversion: 2.1 time: 0.297636 Jul 05 13:08:41.376806 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 471/950] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:08:41 2022] GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 => generated 1721 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:08:41.426179 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-4de69770-45f1-4d29-b613-a85fc2a3cf6f tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3212553bb4ae401d9d56f311c779f035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8461fdd34eef42d089eb3c3d7d607518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:08:41.435303 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-4de69770-45f1-4d29-b613-a85fc2a3cf6f tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] 10.222.0.36 "GET /compute/v2.1/servers/8c95e965-abb1-4111-a239-63f7a4a2c05c" status: 200 len: 1319 microversion: 2.1 time: 0.259507 Jul 05 13:08:41.445759 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 480/951] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:08:41 2022] GET /compute/v2.1/servers/8c95e965-abb1-4111-a239-63f7a4a2c05c => generated 1319 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:08:42.393407 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-790ecb81-4b48-4324-bb97-687cb98caa89 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:08:42.394545 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-790ecb81-4b48-4324-bb97-687cb98caa89 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:08:42.402163 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-790ecb81-4b48-4324-bb97-687cb98caa89 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:42.402803 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-790ecb81-4b48-4324-bb97-687cb98caa89 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:42.403746 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-790ecb81-4b48-4324-bb97-687cb98caa89 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:42.404379 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-790ecb81-4b48-4324-bb97-687cb98caa89 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:42.454047 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-55d2687b-aa00-4bb7-80bc-9fe1e3f6e347 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:08:42.455232 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-55d2687b-aa00-4bb7-80bc-9fe1e3f6e347 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] [instance: 8c95e965-abb1-4111-a239-63f7a4a2c05c] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:08:42.482123 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-55d2687b-aa00-4bb7-80bc-9fe1e3f6e347 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:42.482991 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-55d2687b-aa00-4bb7-80bc-9fe1e3f6e347 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:42.485008 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-55d2687b-aa00-4bb7-80bc-9fe1e3f6e347 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:42.485463 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-55d2687b-aa00-4bb7-80bc-9fe1e3f6e347 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:42.621230 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-790ecb81-4b48-4324-bb97-687cb98caa89 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:08:42.630812 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-790ecb81-4b48-4324-bb97-687cb98caa89 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25" status: 200 len: 1721 microversion: 2.1 time: 0.240911 Jul 05 13:08:42.641397 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 472/952] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:08:42 2022] GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 => generated 1721 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:08:42.670364 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-55d2687b-aa00-4bb7-80bc-9fe1e3f6e347 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3212553bb4ae401d9d56f311c779f035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8461fdd34eef42d089eb3c3d7d607518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:08:42.674540 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-55d2687b-aa00-4bb7-80bc-9fe1e3f6e347 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] 10.222.0.36 "GET /compute/v2.1/servers/8c95e965-abb1-4111-a239-63f7a4a2c05c" status: 200 len: 1319 microversion: 2.1 time: 0.225678 Jul 05 13:08:42.675107 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 481/953] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:08:42 2022] GET /compute/v2.1/servers/8c95e965-abb1-4111-a239-63f7a4a2c05c => generated 1319 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:08:43.648789 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-1b062898-4fd7-4475-8843-7f5ca34cd577 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:08:43.649522 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-1b062898-4fd7-4475-8843-7f5ca34cd577 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:08:43.656051 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-1b062898-4fd7-4475-8843-7f5ca34cd577 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:43.656766 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-1b062898-4fd7-4475-8843-7f5ca34cd577 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:43.657600 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-1b062898-4fd7-4475-8843-7f5ca34cd577 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:43.658121 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-1b062898-4fd7-4475-8843-7f5ca34cd577 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:43.691256 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-d5191456-b65c-412c-a18e-bb22c71c2b64 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:08:43.691961 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-d5191456-b65c-412c-a18e-bb22c71c2b64 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] [instance: 8c95e965-abb1-4111-a239-63f7a4a2c05c] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:08:43.693930 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell0:SELECT=2 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:43.708817 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d5191456-b65c-412c-a18e-bb22c71c2b64 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:43.708817 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d5191456-b65c-412c-a18e-bb22c71c2b64 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:43.708817 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d5191456-b65c-412c-a18e-bb22c71c2b64 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:43.709367 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d5191456-b65c-412c-a18e-bb22c71c2b64 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:43.862562 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-1b062898-4fd7-4475-8843-7f5ca34cd577 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:08:43.872133 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-1b062898-4fd7-4475-8843-7f5ca34cd577 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25" status: 200 len: 1698 microversion: 2.1 time: 0.227141 Jul 05 13:08:43.873164 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 473/954] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:08:43 2022] GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 => generated 1698 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:08:43.889759 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-a5de207e-ba85-4981-b3d7-23ee83bddb8f tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:08:43.897119 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a5de207e-ba85-4981-b3d7-23ee83bddb8f tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:43.897674 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a5de207e-ba85-4981-b3d7-23ee83bddb8f tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:43.910703 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-d5191456-b65c-412c-a18e-bb22c71c2b64 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3212553bb4ae401d9d56f311c779f035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8461fdd34eef42d089eb3c3d7d607518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:08:43.922325 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-d5191456-b65c-412c-a18e-bb22c71c2b64 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] 10.222.0.36 "GET /compute/v2.1/servers/8c95e965-abb1-4111-a239-63f7a4a2c05c" status: 200 len: 1319 microversion: 2.1 time: 0.234838 Jul 05 13:08:43.927693 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 482/955] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:08:43 2022] GET /compute/v2.1/servers/8c95e965-abb1-4111-a239-63f7a4a2c05c => generated 1319 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:08:43.963986 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-a5de207e-ba85-4981-b3d7-23ee83bddb8f tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Going to try to start instance {{(pid=118386) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 05 13:08:44.180254 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-a5de207e-ba85-4981-b3d7-23ee83bddb8f tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "POST /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25/action" status: 202 len: 0 microversion: 2.1 time: 0.294088 Jul 05 13:08:44.181411 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 474/956] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Jul 5 13:08:43 2022] POST /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 13:08:44.197737 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-f7c6ee7c-3e23-4441-be65-16b158d2788e tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:08:44.198533 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-f7c6ee7c-3e23-4441-be65-16b158d2788e tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:08:44.212684 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f7c6ee7c-3e23-4441-be65-16b158d2788e tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:44.213400 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f7c6ee7c-3e23-4441-be65-16b158d2788e tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:44.214939 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f7c6ee7c-3e23-4441-be65-16b158d2788e tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:44.215391 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f7c6ee7c-3e23-4441-be65-16b158d2788e tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:44.366299 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-f7c6ee7c-3e23-4441-be65-16b158d2788e tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:08:44.375772 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-f7c6ee7c-3e23-4441-be65-16b158d2788e tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25" status: 200 len: 1707 microversion: 2.1 time: 0.189515 Jul 05 13:08:44.380641 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 483/957] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:08:44 2022] GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 => generated 1707 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:08:44.941847 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-3aefc5ab-4343-49bc-b002-0bc1521ca438 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:08:44.943620 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-3aefc5ab-4343-49bc-b002-0bc1521ca438 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] [instance: 8c95e965-abb1-4111-a239-63f7a4a2c05c] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:08:44.945702 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_cell0:SELECT=2 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:44.951566 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-3aefc5ab-4343-49bc-b002-0bc1521ca438 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:44.952066 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-3aefc5ab-4343-49bc-b002-0bc1521ca438 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:44.952970 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-3aefc5ab-4343-49bc-b002-0bc1521ca438 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:44.960370 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-3aefc5ab-4343-49bc-b002-0bc1521ca438 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:45.089913 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-3aefc5ab-4343-49bc-b002-0bc1521ca438 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3212553bb4ae401d9d56f311c779f035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8461fdd34eef42d089eb3c3d7d607518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:08:45.097669 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-3aefc5ab-4343-49bc-b002-0bc1521ca438 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] 10.222.0.36 "GET /compute/v2.1/servers/8c95e965-abb1-4111-a239-63f7a4a2c05c" status: 200 len: 1319 microversion: 2.1 time: 0.161667 Jul 05 13:08:45.098254 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 475/958] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:08:44 2022] GET /compute/v2.1/servers/8c95e965-abb1-4111-a239-63f7a4a2c05c => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:08:45.394639 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-29178001-380c-42af-b588-71f40da4e848 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:08:45.395250 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-29178001-380c-42af-b588-71f40da4e848 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:08:45.401764 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-29178001-380c-42af-b588-71f40da4e848 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:45.402219 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-29178001-380c-42af-b588-71f40da4e848 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:45.403060 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-29178001-380c-42af-b588-71f40da4e848 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:45.403498 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-29178001-380c-42af-b588-71f40da4e848 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:45.500887 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell0:SELECT=8 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:45.539044 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-29178001-380c-42af-b588-71f40da4e848 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:08:45.549714 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-29178001-380c-42af-b588-71f40da4e848 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25" status: 200 len: 1707 microversion: 2.1 time: 0.158915 Jul 05 13:08:45.550750 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 484/959] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:08:45 2022] GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 => generated 1707 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:08:46.114626 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-e11d670d-cf98-4544-98cb-803cb0651519 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:08:46.115240 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-e11d670d-cf98-4544-98cb-803cb0651519 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] [instance: 8c95e965-abb1-4111-a239-63f7a4a2c05c] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:08:46.127199 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e11d670d-cf98-4544-98cb-803cb0651519 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:46.127651 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e11d670d-cf98-4544-98cb-803cb0651519 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:46.128951 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e11d670d-cf98-4544-98cb-803cb0651519 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:46.128951 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e11d670d-cf98-4544-98cb-803cb0651519 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:46.271941 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-e11d670d-cf98-4544-98cb-803cb0651519 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3212553bb4ae401d9d56f311c779f035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8461fdd34eef42d089eb3c3d7d607518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:08:46.280009 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-e11d670d-cf98-4544-98cb-803cb0651519 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] 10.222.0.36 "GET /compute/v2.1/servers/8c95e965-abb1-4111-a239-63f7a4a2c05c" status: 200 len: 1319 microversion: 2.1 time: 0.169174 Jul 05 13:08:46.281187 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 476/960] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:08:46 2022] GET /compute/v2.1/servers/8c95e965-abb1-4111-a239-63f7a4a2c05c => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:08:46.323869 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-f4435988-f4cb-4856-b6b7-dec43e2c1a62 req-7eeadd84-9a5c-4515-82d9-a03e09d7caea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c95e965-abb1-4111-a239-63f7a4a2c05c", "name": "network-vif-plugged", "status": "completed", "tag": "563fa8b1-1ab2-40f4-8eef-a4f69de63ad8"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:08:46.337698 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-f4435988-f4cb-4856-b6b7-dec43e2c1a62 req-7eeadd84-9a5c-4515-82d9-a03e09d7caea service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:46.337698 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-f4435988-f4cb-4856-b6b7-dec43e2c1a62 req-7eeadd84-9a5c-4515-82d9-a03e09d7caea service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:46.344427 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-f4435988-f4cb-4856-b6b7-dec43e2c1a62 req-7eeadd84-9a5c-4515-82d9-a03e09d7caea service nova] Creating event network-vif-plugged:563fa8b1-1ab2-40f4-8eef-a4f69de63ad8 for instance 8c95e965-abb1-4111-a239-63f7a4a2c05c on hv-cinder-79760 Jul 05 13:08:46.349241 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-f4435988-f4cb-4856-b6b7-dec43e2c1a62 req-7eeadd84-9a5c-4515-82d9-a03e09d7caea service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030767 Jul 05 13:08:46.349834 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 485/961] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:08:46.568540 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-b0698500-f3b0-481c-a63c-32aa3e8e10de tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:08:46.569087 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-b0698500-f3b0-481c-a63c-32aa3e8e10de tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:08:46.576169 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b0698500-f3b0-481c-a63c-32aa3e8e10de tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:46.576637 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b0698500-f3b0-481c-a63c-32aa3e8e10de tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:46.577413 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b0698500-f3b0-481c-a63c-32aa3e8e10de tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:46.577848 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b0698500-f3b0-481c-a63c-32aa3e8e10de tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:46.722385 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-b0698500-f3b0-481c-a63c-32aa3e8e10de tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:08:46.731160 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-b0698500-f3b0-481c-a63c-32aa3e8e10de tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25" status: 200 len: 1711 microversion: 2.1 time: 0.166353 Jul 05 13:08:46.731733 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 477/962] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:08:46 2022] GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 => generated 1711 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:08:47.298589 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-9a3c82e3-5a5e-4c4f-8856-cf7022e51bd3 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:08:47.299291 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-9a3c82e3-5a5e-4c4f-8856-cf7022e51bd3 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] [instance: 8c95e965-abb1-4111-a239-63f7a4a2c05c] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:08:47.305566 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9a3c82e3-5a5e-4c4f-8856-cf7022e51bd3 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:47.306622 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9a3c82e3-5a5e-4c4f-8856-cf7022e51bd3 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:47.307385 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9a3c82e3-5a5e-4c4f-8856-cf7022e51bd3 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:47.307821 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9a3c82e3-5a5e-4c4f-8856-cf7022e51bd3 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:47.438695 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-9a3c82e3-5a5e-4c4f-8856-cf7022e51bd3 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3212553bb4ae401d9d56f311c779f035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8461fdd34eef42d089eb3c3d7d607518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:08:47.446194 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-9a3c82e3-5a5e-4c4f-8856-cf7022e51bd3 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] 10.222.0.36 "GET /compute/v2.1/servers/8c95e965-abb1-4111-a239-63f7a4a2c05c" status: 200 len: 1319 microversion: 2.1 time: 0.152327 Jul 05 13:08:47.446772 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 486/963] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:08:47 2022] GET /compute/v2.1/servers/8c95e965-abb1-4111-a239-63f7a4a2c05c => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:08:48.462457 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-9b777223-45f4-4003-a69e-bbe389f90a13 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:08:48.463070 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-9b777223-45f4-4003-a69e-bbe389f90a13 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] [instance: 8c95e965-abb1-4111-a239-63f7a4a2c05c] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:08:48.469499 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-9b777223-45f4-4003-a69e-bbe389f90a13 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:48.469956 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-9b777223-45f4-4003-a69e-bbe389f90a13 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:48.470775 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-9b777223-45f4-4003-a69e-bbe389f90a13 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:08:48.471230 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-9b777223-45f4-4003-a69e-bbe389f90a13 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:08:48.613123 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-9b777223-45f4-4003-a69e-bbe389f90a13 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3212553bb4ae401d9d56f311c779f035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8461fdd34eef42d089eb3c3d7d607518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:08:48.621061 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-9b777223-45f4-4003-a69e-bbe389f90a13 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] 10.222.0.36 "GET /compute/v2.1/servers/8c95e965-abb1-4111-a239-63f7a4a2c05c" status: 200 len: 1508 microversion: 2.1 time: 0.162454 Jul 05 13:08:48.621623 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 478/964] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:08:48 2022] GET /compute/v2.1/servers/8c95e965-abb1-4111-a239-63f7a4a2c05c => generated 1508 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:09:06.236063 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-dd16e6a8-832c-4fba-a5b2-2a371b8b60fb tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "00f0aa71-c299-47a7-a82e-37b0016066a5", "device": "/dev/sdb"}} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:09:06.237689 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-dd16e6a8-832c-4fba-a5b2-2a371b8b60fb tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] [instance: 8c95e965-abb1-4111-a239-63f7a4a2c05c] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:09:06.239870 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_api:SELECT=17 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:09:06.240575 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell1:SELECT=56 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:09:06.245706 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-dd16e6a8-832c-4fba-a5b2-2a371b8b60fb tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:06.245902 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-dd16e6a8-832c-4fba-a5b2-2a371b8b60fb tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:06.246644 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-dd16e6a8-832c-4fba-a5b2-2a371b8b60fb tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:06.247578 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-dd16e6a8-832c-4fba-a5b2-2a371b8b60fb tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:07.247677 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-dd16e6a8-832c-4fba-a5b2-2a371b8b60fb tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] 10.222.0.36 "POST /compute/v2.1/servers/8c95e965-abb1-4111-a239-63f7a4a2c05c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.015558 Jul 05 13:09:07.248349 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 487/965] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Jul 5 13:09:06 2022] POST /compute/v2.1/servers/8c95e965-abb1-4111-a239-63f7a4a2c05c/os-volume_attachments => generated 194 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:09:27.811046 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-6abfceab-8ed3-41ce-b4b0-68af8efd99b4 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:09:27.811590 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-6abfceab-8ed3-41ce-b4b0-68af8efd99b4 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:09:27.814431 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_api:SELECT=19 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:09:27.815106 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:09:27.819700 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-6abfceab-8ed3-41ce-b4b0-68af8efd99b4 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:27.820141 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-6abfceab-8ed3-41ce-b4b0-68af8efd99b4 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:27.820932 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-6abfceab-8ed3-41ce-b4b0-68af8efd99b4 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:27.821372 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-6abfceab-8ed3-41ce-b4b0-68af8efd99b4 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:27.898613 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.objects.instance [None req-6abfceab-8ed3-41ce-b4b0-68af8efd99b4 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lazy-loading 'services' on Instance uuid b55ca313-2e09-4b58-b7e7-cdda74ffdd25 {{(pid=118386) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 13:09:28.152337 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-6abfceab-8ed3-41ce-b4b0-68af8efd99b4 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25/os-volume_attachments/df864550-5675-46b6-ba12-b203281af196" status: 202 len: 0 microversion: 2.1 time: 0.345157 Jul 05 13:09:28.152959 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 479/966] 10.222.0.36 () {58 vars in 1415 bytes} [Tue Jul 5 13:09:27 2022] DELETE /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25/os-volume_attachments/df864550-5675-46b6-ba12-b203281af196 => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 13:09:30.318440 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_api:SELECT=2 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:09:30.319171 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:09:30.323389 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-4b24304b-95b0-4f76-ad14-feed092435a7 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:09:30.330416 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4b24304b-95b0-4f76-ad14-feed092435a7 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:30.330865 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4b24304b-95b0-4f76-ad14-feed092435a7 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:30.353730 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-4b24304b-95b0-4f76-ad14-feed092435a7 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Going to try to stop instance {{(pid=118387) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 05 13:09:30.543188 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-4b24304b-95b0-4f76-ad14-feed092435a7 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "POST /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25/action" status: 202 len: 0 microversion: 2.1 time: 0.226028 Jul 05 13:09:30.543793 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 488/967] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Jul 5 13:09:30 2022] POST /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 13:09:30.552815 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-87dfec65-509c-4fbd-a658-65f6db1d8a37 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:09:30.553510 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-87dfec65-509c-4fbd-a658-65f6db1d8a37 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:09:30.560334 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-87dfec65-509c-4fbd-a658-65f6db1d8a37 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:30.560806 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-87dfec65-509c-4fbd-a658-65f6db1d8a37 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:30.561570 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-87dfec65-509c-4fbd-a658-65f6db1d8a37 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:30.562000 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-87dfec65-509c-4fbd-a658-65f6db1d8a37 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:30.694739 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-87dfec65-509c-4fbd-a658-65f6db1d8a37 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:09:30.702127 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-87dfec65-509c-4fbd-a658-65f6db1d8a37 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25" status: 200 len: 1675 microversion: 2.1 time: 0.154065 Jul 05 13:09:30.702681 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 480/968] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:09:30 2022] GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:09:31.720941 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-590e6079-370e-4b2c-8604-8ce0727f765e tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:09:31.721594 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-590e6079-370e-4b2c-8604-8ce0727f765e tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:09:31.728499 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-590e6079-370e-4b2c-8604-8ce0727f765e tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:31.728983 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-590e6079-370e-4b2c-8604-8ce0727f765e tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:31.732492 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-590e6079-370e-4b2c-8604-8ce0727f765e tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:31.732492 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-590e6079-370e-4b2c-8604-8ce0727f765e tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:31.858157 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-590e6079-370e-4b2c-8604-8ce0727f765e tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:09:31.865566 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-590e6079-370e-4b2c-8604-8ce0727f765e tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25" status: 200 len: 1675 microversion: 2.1 time: 0.150059 Jul 05 13:09:31.866125 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 489/969] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:09:31 2022] GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:09:32.011867 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-61bead90-6b33-49a4-8c18-6115ad0f6cbc tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:09:32.012354 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-61bead90-6b33-49a4-8c18-6115ad0f6cbc tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] [instance: 8c95e965-abb1-4111-a239-63f7a4a2c05c] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:09:32.019314 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-61bead90-6b33-49a4-8c18-6115ad0f6cbc tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:32.019755 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-61bead90-6b33-49a4-8c18-6115ad0f6cbc tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:32.020503 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-61bead90-6b33-49a4-8c18-6115ad0f6cbc tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:32.020955 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-61bead90-6b33-49a4-8c18-6115ad0f6cbc tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:32.100272 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.objects.instance [None req-61bead90-6b33-49a4-8c18-6115ad0f6cbc tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lazy-loading 'services' on Instance uuid 8c95e965-abb1-4111-a239-63f7a4a2c05c {{(pid=118386) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 13:09:32.357788 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-61bead90-6b33-49a4-8c18-6115ad0f6cbc tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8c95e965-abb1-4111-a239-63f7a4a2c05c/os-volume_attachments/00f0aa71-c299-47a7-a82e-37b0016066a5" status: 202 len: 0 microversion: 2.1 time: 0.349561 Jul 05 13:09:32.358462 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 481/970] 10.222.0.36 () {58 vars in 1415 bytes} [Tue Jul 5 13:09:32 2022] DELETE /compute/v2.1/servers/8c95e965-abb1-4111-a239-63f7a4a2c05c/os-volume_attachments/00f0aa71-c299-47a7-a82e-37b0016066a5 => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 13:09:32.881873 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-04620462-ddb5-4e96-a892-974a2d9757e9 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:09:32.882528 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-04620462-ddb5-4e96-a892-974a2d9757e9 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:09:32.889183 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-04620462-ddb5-4e96-a892-974a2d9757e9 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:32.890847 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-04620462-ddb5-4e96-a892-974a2d9757e9 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:32.890847 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-04620462-ddb5-4e96-a892-974a2d9757e9 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:32.891059 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-04620462-ddb5-4e96-a892-974a2d9757e9 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:33.025674 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-04620462-ddb5-4e96-a892-974a2d9757e9 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:09:33.033942 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-04620462-ddb5-4e96-a892-974a2d9757e9 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25" status: 200 len: 1675 microversion: 2.1 time: 0.155858 Jul 05 13:09:33.040184 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 490/971] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:09:32 2022] GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:09:33.481929 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-5c147cb2-31fd-4492-978e-5db1daa19e43 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:09:33.482499 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-5c147cb2-31fd-4492-978e-5db1daa19e43 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] [instance: 8c95e965-abb1-4111-a239-63f7a4a2c05c] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:09:33.489280 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-5c147cb2-31fd-4492-978e-5db1daa19e43 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:33.489735 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-5c147cb2-31fd-4492-978e-5db1daa19e43 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:33.490498 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-5c147cb2-31fd-4492-978e-5db1daa19e43 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:33.490933 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-5c147cb2-31fd-4492-978e-5db1daa19e43 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:33.517362 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-5c147cb2-31fd-4492-978e-5db1daa19e43 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] [instance: 8c95e965-abb1-4111-a239-63f7a4a2c05c] Going to try to terminate instance {{(pid=118386) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 13:09:33.850587 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-5c147cb2-31fd-4492-978e-5db1daa19e43 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8c95e965-abb1-4111-a239-63f7a4a2c05c" status: 204 len: 0 microversion: 2.1 time: 0.373198 Jul 05 13:09:33.851264 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 482/972] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jul 5 13:09:33 2022] DELETE /compute/v2.1/servers/8c95e965-abb1-4111-a239-63f7a4a2c05c => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 05 13:09:33.859631 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-0bb62c7c-914f-46b7-8c7d-56bd64b2c238 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:09:33.860403 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-0bb62c7c-914f-46b7-8c7d-56bd64b2c238 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] [instance: 8c95e965-abb1-4111-a239-63f7a4a2c05c] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:09:33.866735 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0bb62c7c-914f-46b7-8c7d-56bd64b2c238 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:33.867253 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0bb62c7c-914f-46b7-8c7d-56bd64b2c238 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:33.874614 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0bb62c7c-914f-46b7-8c7d-56bd64b2c238 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:33.874614 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0bb62c7c-914f-46b7-8c7d-56bd64b2c238 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:33.998682 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-0bb62c7c-914f-46b7-8c7d-56bd64b2c238 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3212553bb4ae401d9d56f311c779f035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8461fdd34eef42d089eb3c3d7d607518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:09:34.005444 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-0bb62c7c-914f-46b7-8c7d-56bd64b2c238 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] 10.222.0.36 "GET /compute/v2.1/servers/8c95e965-abb1-4111-a239-63f7a4a2c05c" status: 200 len: 1514 microversion: 2.1 time: 0.149898 Jul 05 13:09:34.009866 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 491/973] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:09:33 2022] GET /compute/v2.1/servers/8c95e965-abb1-4111-a239-63f7a4a2c05c => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:09:34.050899 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-663611f3-ed3f-47ae-af7c-fd5c4278cccc tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:09:34.051748 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-663611f3-ed3f-47ae-af7c-fd5c4278cccc tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:09:34.057822 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-663611f3-ed3f-47ae-af7c-fd5c4278cccc tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:34.058337 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-663611f3-ed3f-47ae-af7c-fd5c4278cccc tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:34.059180 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-663611f3-ed3f-47ae-af7c-fd5c4278cccc tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:34.059679 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-663611f3-ed3f-47ae-af7c-fd5c4278cccc tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:34.195384 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-663611f3-ed3f-47ae-af7c-fd5c4278cccc tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:09:34.203179 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-663611f3-ed3f-47ae-af7c-fd5c4278cccc tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25" status: 200 len: 1675 microversion: 2.1 time: 0.156493 Jul 05 13:09:34.203825 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 483/974] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:09:34 2022] GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:09:35.025271 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-d305af6e-8fd8-4200-8abd-ec86d567618b tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:09:35.025985 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-d305af6e-8fd8-4200-8abd-ec86d567618b tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] [instance: 8c95e965-abb1-4111-a239-63f7a4a2c05c] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:09:35.032459 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d305af6e-8fd8-4200-8abd-ec86d567618b tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:35.032941 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d305af6e-8fd8-4200-8abd-ec86d567618b tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:35.034193 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d305af6e-8fd8-4200-8abd-ec86d567618b tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:35.034627 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d305af6e-8fd8-4200-8abd-ec86d567618b tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:35.164995 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-d305af6e-8fd8-4200-8abd-ec86d567618b tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3212553bb4ae401d9d56f311c779f035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8461fdd34eef42d089eb3c3d7d607518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:09:35.172383 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-d305af6e-8fd8-4200-8abd-ec86d567618b tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] 10.222.0.36 "GET /compute/v2.1/servers/8c95e965-abb1-4111-a239-63f7a4a2c05c" status: 200 len: 1514 microversion: 2.1 time: 0.150961 Jul 05 13:09:35.172992 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 492/975] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:09:35 2022] GET /compute/v2.1/servers/8c95e965-abb1-4111-a239-63f7a4a2c05c => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:09:35.221568 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-5fb05073-bb7f-445e-bf0e-e29b43ba1c80 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:09:35.222322 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-5fb05073-bb7f-445e-bf0e-e29b43ba1c80 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:09:35.228908 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-5fb05073-bb7f-445e-bf0e-e29b43ba1c80 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:35.229359 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-5fb05073-bb7f-445e-bf0e-e29b43ba1c80 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:35.230388 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-5fb05073-bb7f-445e-bf0e-e29b43ba1c80 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:35.230828 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-5fb05073-bb7f-445e-bf0e-e29b43ba1c80 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:35.357842 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-5fb05073-bb7f-445e-bf0e-e29b43ba1c80 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:09:35.365547 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-5fb05073-bb7f-445e-bf0e-e29b43ba1c80 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25" status: 200 len: 1675 microversion: 2.1 time: 0.148344 Jul 05 13:09:35.370836 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 484/976] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:09:35 2022] GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 => generated 1675 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:09:36.189232 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-9883ecf0-4368-418d-92c7-40597101bff1 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:09:36.190406 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-9883ecf0-4368-418d-92c7-40597101bff1 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] [instance: 8c95e965-abb1-4111-a239-63f7a4a2c05c] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:09:36.196876 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9883ecf0-4368-418d-92c7-40597101bff1 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:36.197352 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9883ecf0-4368-418d-92c7-40597101bff1 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:36.198112 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9883ecf0-4368-418d-92c7-40597101bff1 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:36.198546 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9883ecf0-4368-418d-92c7-40597101bff1 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:36.329727 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-9883ecf0-4368-418d-92c7-40597101bff1 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3212553bb4ae401d9d56f311c779f035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8461fdd34eef42d089eb3c3d7d607518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:09:36.337261 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-9883ecf0-4368-418d-92c7-40597101bff1 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] 10.222.0.36 "GET /compute/v2.1/servers/8c95e965-abb1-4111-a239-63f7a4a2c05c" status: 200 len: 1514 microversion: 2.1 time: 0.151960 Jul 05 13:09:36.337821 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 493/977] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:09:36 2022] GET /compute/v2.1/servers/8c95e965-abb1-4111-a239-63f7a4a2c05c => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:09:36.385894 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-f5ada0df-4efc-444b-bbd3-0fbd23376649 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:09:36.386507 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-f5ada0df-4efc-444b-bbd3-0fbd23376649 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:09:36.393094 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f5ada0df-4efc-444b-bbd3-0fbd23376649 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:36.393530 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f5ada0df-4efc-444b-bbd3-0fbd23376649 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:36.394276 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f5ada0df-4efc-444b-bbd3-0fbd23376649 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:36.394707 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f5ada0df-4efc-444b-bbd3-0fbd23376649 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:36.529287 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-f5ada0df-4efc-444b-bbd3-0fbd23376649 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:09:36.537695 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-f5ada0df-4efc-444b-bbd3-0fbd23376649 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25" status: 200 len: 1675 microversion: 2.1 time: 0.155690 Jul 05 13:09:36.538265 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 485/978] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:09:36 2022] GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:09:37.354589 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-23f8b795-6570-4ffc-a3a9-c79b4e03043b tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:09:37.355367 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-23f8b795-6570-4ffc-a3a9-c79b4e03043b tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] [instance: 8c95e965-abb1-4111-a239-63f7a4a2c05c] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:09:37.362831 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-23f8b795-6570-4ffc-a3a9-c79b4e03043b tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:37.363288 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-23f8b795-6570-4ffc-a3a9-c79b4e03043b tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:37.364065 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-23f8b795-6570-4ffc-a3a9-c79b4e03043b tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:37.364508 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-23f8b795-6570-4ffc-a3a9-c79b4e03043b tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:37.505908 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-23f8b795-6570-4ffc-a3a9-c79b4e03043b tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3212553bb4ae401d9d56f311c779f035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8461fdd34eef42d089eb3c3d7d607518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:09:37.514175 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-23f8b795-6570-4ffc-a3a9-c79b4e03043b tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] 10.222.0.36 "GET /compute/v2.1/servers/8c95e965-abb1-4111-a239-63f7a4a2c05c" status: 200 len: 1514 microversion: 2.1 time: 0.163514 Jul 05 13:09:37.514751 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 494/979] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:09:37 2022] GET /compute/v2.1/servers/8c95e965-abb1-4111-a239-63f7a4a2c05c => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:09:37.555436 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-2f5457a9-e359-4b52-b588-4412a572af86 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:09:37.556054 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-2f5457a9-e359-4b52-b588-4412a572af86 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:09:37.562542 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-2f5457a9-e359-4b52-b588-4412a572af86 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:37.562998 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-2f5457a9-e359-4b52-b588-4412a572af86 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:37.563759 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-2f5457a9-e359-4b52-b588-4412a572af86 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:37.564198 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-2f5457a9-e359-4b52-b588-4412a572af86 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:37.695938 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-2f5457a9-e359-4b52-b588-4412a572af86 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:09:37.703472 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-2f5457a9-e359-4b52-b588-4412a572af86 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25" status: 200 len: 1675 microversion: 2.1 time: 0.151956 Jul 05 13:09:37.704047 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 486/980] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:09:37 2022] GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:09:38.531286 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-862e809b-b2be-4647-bb2e-4e39d065d92c tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:09:38.531905 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-862e809b-b2be-4647-bb2e-4e39d065d92c tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] [instance: 8c95e965-abb1-4111-a239-63f7a4a2c05c] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:09:38.540126 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-862e809b-b2be-4647-bb2e-4e39d065d92c tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:38.540126 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-862e809b-b2be-4647-bb2e-4e39d065d92c tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:38.542147 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-862e809b-b2be-4647-bb2e-4e39d065d92c tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:38.542601 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-862e809b-b2be-4647-bb2e-4e39d065d92c tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:38.679771 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-862e809b-b2be-4647-bb2e-4e39d065d92c tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3212553bb4ae401d9d56f311c779f035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8461fdd34eef42d089eb3c3d7d607518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:09:38.690320 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-862e809b-b2be-4647-bb2e-4e39d065d92c tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] 10.222.0.36 "GET /compute/v2.1/servers/8c95e965-abb1-4111-a239-63f7a4a2c05c" status: 200 len: 1514 microversion: 2.1 time: 0.162795 Jul 05 13:09:38.691173 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 495/981] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:09:38 2022] GET /compute/v2.1/servers/8c95e965-abb1-4111-a239-63f7a4a2c05c => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:09:38.724630 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-9e54bc6b-9567-4315-bc58-f3de9cbfb8cc tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:09:38.725479 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-9e54bc6b-9567-4315-bc58-f3de9cbfb8cc tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:09:38.739169 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-9e54bc6b-9567-4315-bc58-f3de9cbfb8cc tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:38.739169 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-9e54bc6b-9567-4315-bc58-f3de9cbfb8cc tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:38.739169 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-9e54bc6b-9567-4315-bc58-f3de9cbfb8cc tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:38.739169 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-9e54bc6b-9567-4315-bc58-f3de9cbfb8cc tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:38.798594 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-562e7d30-1de4-45ad-a80d-6d0bed33b53b req-9d686ad1-8008-4914-8199-147f21268456 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c95e965-abb1-4111-a239-63f7a4a2c05c", "name": "network-vif-deleted", "tag": "563fa8b1-1ab2-40f4-8eef-a4f69de63ad8"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:09:38.807595 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-562e7d30-1de4-45ad-a80d-6d0bed33b53b req-9d686ad1-8008-4914-8199-147f21268456 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:38.808355 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-562e7d30-1de4-45ad-a80d-6d0bed33b53b req-9d686ad1-8008-4914-8199-147f21268456 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:38.820892 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-562e7d30-1de4-45ad-a80d-6d0bed33b53b req-9d686ad1-8008-4914-8199-147f21268456 service nova] Creating event network-vif-deleted:563fa8b1-1ab2-40f4-8eef-a4f69de63ad8 for instance 8c95e965-abb1-4111-a239-63f7a4a2c05c on hv-cinder-79760 Jul 05 13:09:38.825899 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-562e7d30-1de4-45ad-a80d-6d0bed33b53b req-9d686ad1-8008-4914-8199-147f21268456 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031024 Jul 05 13:09:38.826876 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 496/982] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 13:09:38.885587 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-9e54bc6b-9567-4315-bc58-f3de9cbfb8cc tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:09:38.894444 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-9e54bc6b-9567-4315-bc58-f3de9cbfb8cc tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25" status: 200 len: 1675 microversion: 2.1 time: 0.176679 Jul 05 13:09:38.895119 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 487/983] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:09:38 2022] GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 => generated 1675 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:09:39.709918 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-f41aadd3-8b11-4bd4-9ca8-b2b1749475f8 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:09:39.710649 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-f41aadd3-8b11-4bd4-9ca8-b2b1749475f8 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] [instance: 8c95e965-abb1-4111-a239-63f7a4a2c05c] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:09:39.716846 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f41aadd3-8b11-4bd4-9ca8-b2b1749475f8 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:39.717299 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f41aadd3-8b11-4bd4-9ca8-b2b1749475f8 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:39.718068 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f41aadd3-8b11-4bd4-9ca8-b2b1749475f8 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:39.718533 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f41aadd3-8b11-4bd4-9ca8-b2b1749475f8 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:39.749929 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f41aadd3-8b11-4bd4-9ca8-b2b1749475f8 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:39.750378 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f41aadd3-8b11-4bd4-9ca8-b2b1749475f8 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:39.750856 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.objects.instance [None req-f41aadd3-8b11-4bd4-9ca8-b2b1749475f8 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lazy-loading 'fault' on Instance uuid 8c95e965-abb1-4111-a239-63f7a4a2c05c {{(pid=118387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 13:09:39.795559 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-f41aadd3-8b11-4bd4-9ca8-b2b1749475f8 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3212553bb4ae401d9d56f311c779f035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8461fdd34eef42d089eb3c3d7d607518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:09:39.803011 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-f41aadd3-8b11-4bd4-9ca8-b2b1749475f8 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] 10.222.0.36 "GET /compute/v2.1/servers/8c95e965-abb1-4111-a239-63f7a4a2c05c" status: 200 len: 1309 microversion: 2.1 time: 0.098884 Jul 05 13:09:39.803567 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 497/984] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:09:39 2022] GET /compute/v2.1/servers/8c95e965-abb1-4111-a239-63f7a4a2c05c => generated 1309 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:09:39.911699 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-6be12952-4584-45a4-a387-3e5b6444561e tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:09:39.912431 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-6be12952-4584-45a4-a387-3e5b6444561e tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:09:39.919166 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-6be12952-4584-45a4-a387-3e5b6444561e tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:39.930725 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-6be12952-4584-45a4-a387-3e5b6444561e tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:39.930725 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-6be12952-4584-45a4-a387-3e5b6444561e tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:39.930725 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-6be12952-4584-45a4-a387-3e5b6444561e tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:40.053843 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-6be12952-4584-45a4-a387-3e5b6444561e tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:09:40.061554 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-6be12952-4584-45a4-a387-3e5b6444561e tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25" status: 200 len: 1675 microversion: 2.1 time: 0.154267 Jul 05 13:09:40.073509 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 488/985] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:09:39 2022] GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:09:40.819717 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-a9f0055f-35e0-4d64-a9c3-0881a1416138 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:09:40.820331 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-a9f0055f-35e0-4d64-a9c3-0881a1416138 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] [instance: 8c95e965-abb1-4111-a239-63f7a4a2c05c] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:09:40.827115 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a9f0055f-35e0-4d64-a9c3-0881a1416138 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:40.827562 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a9f0055f-35e0-4d64-a9c3-0881a1416138 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:40.828335 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a9f0055f-35e0-4d64-a9c3-0881a1416138 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:40.828806 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a9f0055f-35e0-4d64-a9c3-0881a1416138 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:40.842711 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.wsgi [None req-a9f0055f-35e0-4d64-a9c3-0881a1416138 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] HTTP exception thrown: Instance 8c95e965-abb1-4111-a239-63f7a4a2c05c could not be found. Jul 05 13:09:40.844345 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-a9f0055f-35e0-4d64-a9c3-0881a1416138 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Request method failure captured: Jul 05 13:09:40.844345 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: request: GET /compute/v2.1/servers/8c95e965-abb1-4111-a239-63f7a4a2c05c HTTP/1.1 Jul 05 13:09:40.844345 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept: application/json Jul 05 13:09:40.844345 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept-Encoding: identity Jul 05 13:09:40.844345 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Connection: close Jul 05 13:09:40.844345 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Length: 0 Jul 05 13:09:40.844345 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Type: application/json Jul 05 13:09:40.844345 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Host: 10.222.0.36 Jul 05 13:09:40.844345 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Openstack-System-Scope: None Jul 05 13:09:40.844345 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: User-Agent: python-urllib3/1.26.9 Jul 05 13:09:40.844345 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Auth-Token: gAAAAABixDfOLff87vyYbiC7Yt3kToYC_SrLc2Sow12cIvzWwyjHhb_8NCAKjJRXWJBcMrgllHhlzKGu8oQZTn5C2Ikfp4cGFAbcKxp_XZBEyaUh_E9NTR3ueGBpSPXlXZPbIRrrKYUQlUFA1KOIMu35pL2EkFqq5Ii5jIuuL3KO2ctlb-pvIro Jul 05 13:09:40.844345 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Id: None Jul 05 13:09:40.844345 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Name: None Jul 05 13:09:40.844345 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Identity-Status: Confirmed Jul 05 13:09:40.844345 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Is-Admin-Project: True Jul 05 13:09:40.844345 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Id: default Jul 05 13:09:40.844345 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Name: Default Jul 05 13:09:40.844345 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Id: 8461fdd34eef42d089eb3c3d7d607518 Jul 05 13:09:40.844345 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Name: tempest-VolumesSnapshotTestJSON-838518118 Jul 05 13:09:40.844345 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Role: member,reader Jul 05 13:09:40.844345 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Roles: member,reader Jul 05 13:09:40.846015 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8461fdd34eef42d089eb3c3d7d607518"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8461fdd34eef42d089eb3c3d7d607518", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8461fdd34eef42d089eb3c3d7d607518"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8461fdd34eef42d089eb3c3d7d607518"}]}] Jul 05 13:09:40.846015 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant: tempest-VolumesSnapshotTestJSON-838518118 Jul 05 13:09:40.846015 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Id: 8461fdd34eef42d089eb3c3d7d607518 Jul 05 13:09:40.846015 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-838518118 Jul 05 13:09:40.846015 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User: tempest-VolumesSnapshotTestJSON-838518118-project Jul 05 13:09:40.846015 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Id: default Jul 05 13:09:40.846015 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Name: Default Jul 05 13:09:40.846015 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Id: 3212553bb4ae401d9d56f311c779f035 Jul 05 13:09:40.846015 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Name: tempest-VolumesSnapshotTestJSON-838518118-project Jul 05 13:09:40.846015 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: method: > Jul 05 13:09:40.846015 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: exception: Instance 8c95e965-abb1-4111-a239-63f7a4a2c05c could not be found. Jul 05 13:09:40.846015 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: action_args: {'id': '8c95e965-abb1-4111-a239-63f7a4a2c05c'} Jul 05 13:09:40.847012 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 13:09:40.847012 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:09:40.847012 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 13:09:40.847012 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 13:09:40.847012 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 13:09:40.847012 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 13:09:40.847012 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 13:09:40.847012 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 13:09:40.847012 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 13:09:40.847012 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 13:09:40.847012 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c95e965-abb1-4111-a239-63f7a4a2c05c could not be found. Jul 05 13:09:40.847012 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:09:40.847012 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:09:40.847012 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:09:40.847012 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:09:40.847012 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:09:40.847012 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:09:40.847012 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 13:09:40.847012 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 13:09:40.847012 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 13:09:40.848647 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 13:09:40.848647 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 13:09:40.848647 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 13:09:40.848647 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 13:09:40.848647 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 13:09:40.848647 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 13:09:40.848647 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 13:09:40.848647 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c95e965-abb1-4111-a239-63f7a4a2c05c could not be found. Jul 05 13:09:40.848647 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:09:40.848647 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:09:40.848647 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:09:40.848647 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:09:40.848647 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:09:40.848647 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:09:40.848647 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 13:09:40.848647 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 13:09:40.848647 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c95e965-abb1-4111-a239-63f7a4a2c05c could not be found. Jul 05 13:09:40.848647 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:09:40.850040 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-a9f0055f-35e0-4d64-a9c3-0881a1416138 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Returning 404 to user: Instance 8c95e965-abb1-4111-a239-63f7a4a2c05c could not be found. {{(pid=118387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 13:09:40.850040 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-a9f0055f-35e0-4d64-a9c3-0881a1416138 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] 10.222.0.36 "GET /compute/v2.1/servers/8c95e965-abb1-4111-a239-63f7a4a2c05c" status: 404 len: 111 microversion: 2.1 time: 0.029898 Jul 05 13:09:40.850040 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 498/986] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:09:40 2022] GET /compute/v2.1/servers/8c95e965-abb1-4111-a239-63f7a4a2c05c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 13:09:41.081884 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-f712b8c6-fe77-493a-bd6b-eea95c2a7ee6 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:09:41.082526 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-f712b8c6-fe77-493a-bd6b-eea95c2a7ee6 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:09:41.089552 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f712b8c6-fe77-493a-bd6b-eea95c2a7ee6 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:41.090001 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f712b8c6-fe77-493a-bd6b-eea95c2a7ee6 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:41.090783 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f712b8c6-fe77-493a-bd6b-eea95c2a7ee6 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:41.091215 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f712b8c6-fe77-493a-bd6b-eea95c2a7ee6 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:41.276737 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-f712b8c6-fe77-493a-bd6b-eea95c2a7ee6 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:09:41.284692 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-f712b8c6-fe77-493a-bd6b-eea95c2a7ee6 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25" status: 200 len: 1675 microversion: 2.1 time: 0.207075 Jul 05 13:09:41.285365 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 489/987] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:09:41 2022] GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 => generated 1675 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:09:41.407637 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-b4816f17-a9b0-4422-904f-05bb463f31b1 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1793832688", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1066638790", "security_groups": [{"name": "tempest-secgroup-smoke-350473549"}], "block_device_mapping_v2": [{"uuid": "113b3bd2-c76c-4118-85c9-8ccf19a28d45", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6d0ec387-dad6-4122-8b47-8b2426ab2be9"}]}} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:09:41.526593 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.network.neutron [None req-b4816f17-a9b0-4422-904f-05bb463f31b1 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] validate_networks() for [('6d0ec387-dad6-4122-8b47-8b2426ab2be9', None, None, None, None, None)] {{(pid=118387) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 13:09:41.934269 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-b4816f17-a9b0-4422-904f-05bb463f31b1 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Flavor limits 0:0:0 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 13:09:41.934835 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-b4816f17-a9b0-4422-904f-05bb463f31b1 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Image limits 0:0:0 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 13:09:41.935164 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-b4816f17-a9b0-4422-904f-05bb463f31b1 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Flavor pref 0:0:0 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 13:09:41.935572 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-b4816f17-a9b0-4422-904f-05bb463f31b1 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Image pref 0:0:0 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 13:09:41.935986 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-b4816f17-a9b0-4422-904f-05bb463f31b1 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 13:09:41.945081 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b4816f17-a9b0-4422-904f-05bb463f31b1 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:41.945530 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b4816f17-a9b0-4422-904f-05bb463f31b1 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:41.946326 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b4816f17-a9b0-4422-904f-05bb463f31b1 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:41.946763 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b4816f17-a9b0-4422-904f-05bb463f31b1 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:41.963703 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.quota [None req-b4816f17-a9b0-4422-904f-05bb463f31b1 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Getting quotas for project 277fa3c89dff47b88894b781ff69fb70. Resources: {'instances', 'cores', 'ram'} {{(pid=118387) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 13:09:41.967662 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.quota [None req-b4816f17-a9b0-4422-904f-05bb463f31b1 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Getting quotas for user 661062780f5c45d180a05e402fc7bc27 and project 277fa3c89dff47b88894b781ff69fb70. Resources: {'instances', 'cores', 'ram'} {{(pid=118387) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 13:09:42.026117 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-b4816f17-a9b0-4422-904f-05bb463f31b1 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Going to run 1 instances... {{(pid=118387) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 13:09:42.028264 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-b4816f17-a9b0-4422-904f-05bb463f31b1 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: 674489a9-05f1-4c27-a967-516c16c992b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='113b3bd2-c76c-4118-85c9-8ccf19a28d45',volume_size=None,volume_type=None)] {{(pid=118387) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 13:09:42.307265 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-f29f45b4-3115-4d2a-a77d-98ac809efa23 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:09:42.307896 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-f29f45b4-3115-4d2a-a77d-98ac809efa23 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:09:42.314387 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f29f45b4-3115-4d2a-a77d-98ac809efa23 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:42.315524 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f29f45b4-3115-4d2a-a77d-98ac809efa23 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:42.316294 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f29f45b4-3115-4d2a-a77d-98ac809efa23 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:42.316756 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f29f45b4-3115-4d2a-a77d-98ac809efa23 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:42.456915 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-f29f45b4-3115-4d2a-a77d-98ac809efa23 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:09:42.464430 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-f29f45b4-3115-4d2a-a77d-98ac809efa23 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25" status: 200 len: 1675 microversion: 2.1 time: 0.160923 Jul 05 13:09:42.465152 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 490/988] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:09:42 2022] GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:09:42.480447 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-b4816f17-a9b0-4422-904f-05bb463f31b1 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.076692 Jul 05 13:09:42.481750 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 499/989] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jul 5 13:09:41 2022] POST /compute/v2.1/servers => generated 405 bytes in 1078 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 05 13:09:42.491835 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-8d85b64d-47cc-4f72-afe8-3b0448478f45 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:09:42.492710 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-8d85b64d-47cc-4f72-afe8-3b0448478f45 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: 674489a9-05f1-4c27-a967-516c16c992b1] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:09:42.544428 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-8d85b64d-47cc-4f72-afe8-3b0448478f45 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661062780f5c45d180a05e402fc7bc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277fa3c89dff47b88894b781ff69fb70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:09:42.551735 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-8d85b64d-47cc-4f72-afe8-3b0448478f45 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/674489a9-05f1-4c27-a967-516c16c992b1" status: 200 len: 1095 microversion: 2.1 time: 0.063675 Jul 05 13:09:42.552311 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 491/990] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:09:42 2022] GET /compute/v2.1/servers/674489a9-05f1-4c27-a967-516c16c992b1 => generated 1095 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:09:43.482882 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-665e8de4-277a-4e41-80c6-e25a755c4159 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:09:43.483522 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-665e8de4-277a-4e41-80c6-e25a755c4159 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:09:43.490220 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-665e8de4-277a-4e41-80c6-e25a755c4159 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:43.490668 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-665e8de4-277a-4e41-80c6-e25a755c4159 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:43.491469 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-665e8de4-277a-4e41-80c6-e25a755c4159 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:43.491871 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-665e8de4-277a-4e41-80c6-e25a755c4159 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:43.569726 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-56273037-8452-46b1-8d18-bac0f4a55637 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:09:43.570806 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-56273037-8452-46b1-8d18-bac0f4a55637 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: 674489a9-05f1-4c27-a967-516c16c992b1] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:09:43.642603 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-56273037-8452-46b1-8d18-bac0f4a55637 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661062780f5c45d180a05e402fc7bc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277fa3c89dff47b88894b781ff69fb70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:09:43.651545 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-56273037-8452-46b1-8d18-bac0f4a55637 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/674489a9-05f1-4c27-a967-516c16c992b1" status: 200 len: 1095 microversion: 2.1 time: 0.086195 Jul 05 13:09:43.652510 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 492/991] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:09:43 2022] GET /compute/v2.1/servers/674489a9-05f1-4c27-a967-516c16c992b1 => generated 1095 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:09:43.654965 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-665e8de4-277a-4e41-80c6-e25a755c4159 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:09:43.662759 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-665e8de4-277a-4e41-80c6-e25a755c4159 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25" status: 200 len: 1675 microversion: 2.1 time: 0.184502 Jul 05 13:09:43.663319 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 500/992] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:09:43 2022] GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 => generated 1675 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:09:44.668649 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-a681a820-31df-43ea-9969-6a9bac72c4fa tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:09:44.669328 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-a681a820-31df-43ea-9969-6a9bac72c4fa tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: 674489a9-05f1-4c27-a967-516c16c992b1] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:09:44.677030 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a681a820-31df-43ea-9969-6a9bac72c4fa tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:44.677487 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a681a820-31df-43ea-9969-6a9bac72c4fa tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:44.678269 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a681a820-31df-43ea-9969-6a9bac72c4fa tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:44.678706 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a681a820-31df-43ea-9969-6a9bac72c4fa tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:44.679909 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-df3f653b-c6ed-451b-aa9a-4290f69a374a tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:09:44.681076 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-df3f653b-c6ed-451b-aa9a-4290f69a374a tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:09:44.688057 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-df3f653b-c6ed-451b-aa9a-4290f69a374a tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:44.688505 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-df3f653b-c6ed-451b-aa9a-4290f69a374a tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:44.689308 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-df3f653b-c6ed-451b-aa9a-4290f69a374a tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:44.689740 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-df3f653b-c6ed-451b-aa9a-4290f69a374a tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:44.753525 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-a681a820-31df-43ea-9969-6a9bac72c4fa tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661062780f5c45d180a05e402fc7bc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277fa3c89dff47b88894b781ff69fb70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:09:44.761550 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-a681a820-31df-43ea-9969-6a9bac72c4fa tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/674489a9-05f1-4c27-a967-516c16c992b1" status: 200 len: 1145 microversion: 2.1 time: 0.096790 Jul 05 13:09:44.762208 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 493/993] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:09:44 2022] GET /compute/v2.1/servers/674489a9-05f1-4c27-a967-516c16c992b1 => generated 1145 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:09:44.837766 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-df3f653b-c6ed-451b-aa9a-4290f69a374a tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:09:44.845398 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-df3f653b-c6ed-451b-aa9a-4290f69a374a tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25" status: 200 len: 1675 microversion: 2.1 time: 0.169561 Jul 05 13:09:44.846502 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 501/994] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:09:44 2022] GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 => generated 1675 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:09:45.782777 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-7cc2efb8-d09d-48c1-a219-f6191533032f tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:09:45.783701 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-7cc2efb8-d09d-48c1-a219-f6191533032f tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: 674489a9-05f1-4c27-a967-516c16c992b1] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:09:45.797962 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-7cc2efb8-d09d-48c1-a219-f6191533032f tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:45.798417 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-7cc2efb8-d09d-48c1-a219-f6191533032f tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:45.803320 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-7cc2efb8-d09d-48c1-a219-f6191533032f tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:45.804096 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-7cc2efb8-d09d-48c1-a219-f6191533032f tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:45.833436 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:09:45.865700 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-cdc27c3a-7263-4b3f-9b78-0dcab662564a tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:09:45.866568 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-cdc27c3a-7263-4b3f-9b78-0dcab662564a tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:09:45.875237 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cdc27c3a-7263-4b3f-9b78-0dcab662564a tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:45.875893 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cdc27c3a-7263-4b3f-9b78-0dcab662564a tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:45.879520 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cdc27c3a-7263-4b3f-9b78-0dcab662564a tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:45.879520 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cdc27c3a-7263-4b3f-9b78-0dcab662564a tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:45.879823 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-7cc2efb8-d09d-48c1-a219-f6191533032f tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661062780f5c45d180a05e402fc7bc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277fa3c89dff47b88894b781ff69fb70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:09:45.889818 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-7cc2efb8-d09d-48c1-a219-f6191533032f tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/674489a9-05f1-4c27-a967-516c16c992b1" status: 200 len: 1201 microversion: 2.1 time: 0.114619 Jul 05 13:09:45.890411 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 494/995] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:09:45 2022] GET /compute/v2.1/servers/674489a9-05f1-4c27-a967-516c16c992b1 => generated 1201 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:09:46.032973 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-cdc27c3a-7263-4b3f-9b78-0dcab662564a tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:09:46.040973 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-cdc27c3a-7263-4b3f-9b78-0dcab662564a tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25" status: 200 len: 1675 microversion: 2.1 time: 0.181544 Jul 05 13:09:46.041533 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 502/996] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:09:45 2022] GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 => generated 1675 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:09:46.917558 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-beec25c1-dcbb-4598-8300-1c49ced4181a tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:09:46.918852 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-beec25c1-dcbb-4598-8300-1c49ced4181a tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: 674489a9-05f1-4c27-a967-516c16c992b1] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:09:46.937713 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-beec25c1-dcbb-4598-8300-1c49ced4181a tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:46.938302 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-beec25c1-dcbb-4598-8300-1c49ced4181a tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:46.939652 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-beec25c1-dcbb-4598-8300-1c49ced4181a tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:46.940604 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-beec25c1-dcbb-4598-8300-1c49ced4181a tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:47.060984 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-2e90635c-225d-4d16-a07f-009153bea43d tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:09:47.062378 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-2e90635c-225d-4d16-a07f-009153bea43d tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:09:47.077564 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2e90635c-225d-4d16-a07f-009153bea43d tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:47.078465 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2e90635c-225d-4d16-a07f-009153bea43d tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:47.080121 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2e90635c-225d-4d16-a07f-009153bea43d tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:47.081362 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2e90635c-225d-4d16-a07f-009153bea43d tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:47.104377 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-beec25c1-dcbb-4598-8300-1c49ced4181a tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661062780f5c45d180a05e402fc7bc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277fa3c89dff47b88894b781ff69fb70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:09:47.116660 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-beec25c1-dcbb-4598-8300-1c49ced4181a tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/674489a9-05f1-4c27-a967-516c16c992b1" status: 200 len: 1278 microversion: 2.1 time: 0.204043 Jul 05 13:09:47.117614 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 495/997] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:09:46 2022] GET /compute/v2.1/servers/674489a9-05f1-4c27-a967-516c16c992b1 => generated 1278 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:09:47.239105 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-2e90635c-225d-4d16-a07f-009153bea43d tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:09:47.248236 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-2e90635c-225d-4d16-a07f-009153bea43d tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25" status: 200 len: 1652 microversion: 2.1 time: 0.191887 Jul 05 13:09:47.260804 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 503/998] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:09:47 2022] GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 => generated 1652 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:09:47.272091 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-df303daf-37ae-4e52-8ad9-bfbf67a2b625 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:09:47.278137 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-df303daf-37ae-4e52-8ad9-bfbf67a2b625 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:47.278579 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-df303daf-37ae-4e52-8ad9-bfbf67a2b625 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:47.302009 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-df303daf-37ae-4e52-8ad9-bfbf67a2b625 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Going to try to start instance {{(pid=118386) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 05 13:09:47.522324 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-df303daf-37ae-4e52-8ad9-bfbf67a2b625 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "POST /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25/action" status: 202 len: 0 microversion: 2.1 time: 0.255863 Jul 05 13:09:47.522921 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 496/999] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Jul 5 13:09:47 2022] POST /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 13:09:47.531246 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-616c2076-5247-4ba8-a3ee-97f40ac59623 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:09:47.531979 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-616c2076-5247-4ba8-a3ee-97f40ac59623 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:09:47.539379 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-616c2076-5247-4ba8-a3ee-97f40ac59623 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:47.540874 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-616c2076-5247-4ba8-a3ee-97f40ac59623 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:47.540874 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-616c2076-5247-4ba8-a3ee-97f40ac59623 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:47.541095 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-616c2076-5247-4ba8-a3ee-97f40ac59623 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:47.728296 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-616c2076-5247-4ba8-a3ee-97f40ac59623 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:09:47.740218 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-616c2076-5247-4ba8-a3ee-97f40ac59623 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25" status: 200 len: 1661 microversion: 2.1 time: 0.210983 Jul 05 13:09:47.740851 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 504/1000] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:09:47 2022] GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 => generated 1661 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:09:47.899702 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [req-5111563a-62a9-41fa-9933-4bc954f742f6 req-63450038-e91f-434f-9ef0-4946a1cbd119 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "674489a9-05f1-4c27-a967-516c16c992b1", "tag": "c9bcf6d5-2b90-4b96-80fa-89a15cf69f8c"}]} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:09:47.908482 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-5111563a-62a9-41fa-9933-4bc954f742f6 req-63450038-e91f-434f-9ef0-4946a1cbd119 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:47.909224 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-5111563a-62a9-41fa-9933-4bc954f742f6 req-63450038-e91f-434f-9ef0-4946a1cbd119 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:47.922253 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.compute.server_external_events [req-5111563a-62a9-41fa-9933-4bc954f742f6 req-63450038-e91f-434f-9ef0-4946a1cbd119 service nova] Creating event network-changed:c9bcf6d5-2b90-4b96-80fa-89a15cf69f8c for instance 674489a9-05f1-4c27-a967-516c16c992b1 on hv-cinder-79760 Jul 05 13:09:47.927215 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [req-5111563a-62a9-41fa-9933-4bc954f742f6 req-63450038-e91f-434f-9ef0-4946a1cbd119 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031584 Jul 05 13:09:47.928005 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 497/1001] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:09:48.136440 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-9e1db769-f91c-4f27-be2b-f41b82948756 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:09:48.137418 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-9e1db769-f91c-4f27-be2b-f41b82948756 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: 674489a9-05f1-4c27-a967-516c16c992b1] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:09:48.143589 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9e1db769-f91c-4f27-be2b-f41b82948756 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:48.144039 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9e1db769-f91c-4f27-be2b-f41b82948756 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:48.144844 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9e1db769-f91c-4f27-be2b-f41b82948756 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:48.145282 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9e1db769-f91c-4f27-be2b-f41b82948756 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:48.149415 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:09:48.297317 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-9e1db769-f91c-4f27-be2b-f41b82948756 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661062780f5c45d180a05e402fc7bc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277fa3c89dff47b88894b781ff69fb70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:09:48.305740 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-9e1db769-f91c-4f27-be2b-f41b82948756 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/674489a9-05f1-4c27-a967-516c16c992b1" status: 200 len: 1266 microversion: 2.1 time: 0.173136 Jul 05 13:09:48.306311 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 505/1002] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:09:48 2022] GET /compute/v2.1/servers/674489a9-05f1-4c27-a967-516c16c992b1 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:09:48.758544 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-fe4de6eb-531f-44dd-9d3b-74d177aaa6b5 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:09:48.759233 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-fe4de6eb-531f-44dd-9d3b-74d177aaa6b5 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:09:48.765407 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-fe4de6eb-531f-44dd-9d3b-74d177aaa6b5 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:48.765850 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-fe4de6eb-531f-44dd-9d3b-74d177aaa6b5 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:48.766602 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-fe4de6eb-531f-44dd-9d3b-74d177aaa6b5 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:48.767028 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-fe4de6eb-531f-44dd-9d3b-74d177aaa6b5 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:48.897600 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-fe4de6eb-531f-44dd-9d3b-74d177aaa6b5 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:09:48.905113 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-fe4de6eb-531f-44dd-9d3b-74d177aaa6b5 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25" status: 200 len: 1661 microversion: 2.1 time: 0.151351 Jul 05 13:09:48.905677 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 498/1003] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:09:48 2022] GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 => generated 1661 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:09:49.323165 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-dc420380-38e9-44f2-8f3e-f81497991f90 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:09:49.323715 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-dc420380-38e9-44f2-8f3e-f81497991f90 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: 674489a9-05f1-4c27-a967-516c16c992b1] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:09:49.330785 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-dc420380-38e9-44f2-8f3e-f81497991f90 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:49.331238 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-dc420380-38e9-44f2-8f3e-f81497991f90 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:49.331990 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-dc420380-38e9-44f2-8f3e-f81497991f90 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:49.332423 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-dc420380-38e9-44f2-8f3e-f81497991f90 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:49.461140 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-dc420380-38e9-44f2-8f3e-f81497991f90 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661062780f5c45d180a05e402fc7bc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277fa3c89dff47b88894b781ff69fb70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:09:49.468603 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-dc420380-38e9-44f2-8f3e-f81497991f90 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/674489a9-05f1-4c27-a967-516c16c992b1" status: 200 len: 1266 microversion: 2.1 time: 0.149373 Jul 05 13:09:49.469162 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 506/1004] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:09:49 2022] GET /compute/v2.1/servers/674489a9-05f1-4c27-a967-516c16c992b1 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:09:49.925159 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-527b6499-23e8-4e9a-9b2d-50fb4acf0a49 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:09:49.926075 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-527b6499-23e8-4e9a-9b2d-50fb4acf0a49 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:09:49.935519 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-527b6499-23e8-4e9a-9b2d-50fb4acf0a49 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:49.936192 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-527b6499-23e8-4e9a-9b2d-50fb4acf0a49 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:49.937396 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-527b6499-23e8-4e9a-9b2d-50fb4acf0a49 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:49.938056 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-527b6499-23e8-4e9a-9b2d-50fb4acf0a49 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:50.079338 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-527b6499-23e8-4e9a-9b2d-50fb4acf0a49 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:09:50.087770 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-527b6499-23e8-4e9a-9b2d-50fb4acf0a49 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25" status: 200 len: 1661 microversion: 2.1 time: 0.168811 Jul 05 13:09:50.088337 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 499/1005] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:09:49 2022] GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 => generated 1661 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:09:50.486153 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-4384ed2c-a520-4e2d-818e-0ee7911b0e6e tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:09:50.487274 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-4384ed2c-a520-4e2d-818e-0ee7911b0e6e tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: 674489a9-05f1-4c27-a967-516c16c992b1] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:09:50.494553 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4384ed2c-a520-4e2d-818e-0ee7911b0e6e tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:50.495053 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4384ed2c-a520-4e2d-818e-0ee7911b0e6e tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:50.495903 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4384ed2c-a520-4e2d-818e-0ee7911b0e6e tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:50.496543 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4384ed2c-a520-4e2d-818e-0ee7911b0e6e tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:50.633460 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-4384ed2c-a520-4e2d-818e-0ee7911b0e6e tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661062780f5c45d180a05e402fc7bc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277fa3c89dff47b88894b781ff69fb70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:09:50.640947 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-4384ed2c-a520-4e2d-818e-0ee7911b0e6e tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/674489a9-05f1-4c27-a967-516c16c992b1" status: 200 len: 1266 microversion: 2.1 time: 0.158761 Jul 05 13:09:50.641531 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 507/1006] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:09:50 2022] GET /compute/v2.1/servers/674489a9-05f1-4c27-a967-516c16c992b1 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:09:51.105284 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-bcb4f29f-1629-41b7-a798-15a2815cedfa tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:09:51.105891 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-bcb4f29f-1629-41b7-a798-15a2815cedfa tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:09:51.112884 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-bcb4f29f-1629-41b7-a798-15a2815cedfa tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:51.113336 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-bcb4f29f-1629-41b7-a798-15a2815cedfa tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:51.114122 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-bcb4f29f-1629-41b7-a798-15a2815cedfa tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:51.114536 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-bcb4f29f-1629-41b7-a798-15a2815cedfa tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:51.257701 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-bcb4f29f-1629-41b7-a798-15a2815cedfa tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:09:51.265305 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-bcb4f29f-1629-41b7-a798-15a2815cedfa tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25" status: 200 len: 1661 microversion: 2.1 time: 0.164307 Jul 05 13:09:51.265996 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 500/1007] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:09:51 2022] GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 => generated 1661 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:09:51.472010 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-ec9a2ad4-cbf4-4798-a5cf-cac01bb9a150 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-405843762", "imageRef": "d6134305-a5c0-4d2c-afc8-e54be21f685c", "flavorRef": "452", "networks": [{"uuid": "af4d3eea-1fc4-4fc6-8454-b9bde8c6c614"}]}} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:09:51.526930 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.network.neutron [None req-ec9a2ad4-cbf4-4798-a5cf-cac01bb9a150 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] validate_networks() for [('af4d3eea-1fc4-4fc6-8454-b9bde8c6c614', None, None, None, None, None)] {{(pid=118387) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 13:09:51.658155 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-482d0a7f-f9b0-44cc-942d-56499bf65c66 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:09:51.659534 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-482d0a7f-f9b0-44cc-942d-56499bf65c66 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: 674489a9-05f1-4c27-a967-516c16c992b1] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:09:51.666658 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-482d0a7f-f9b0-44cc-942d-56499bf65c66 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:51.667191 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-482d0a7f-f9b0-44cc-942d-56499bf65c66 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:51.668132 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-482d0a7f-f9b0-44cc-942d-56499bf65c66 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:51.668692 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-482d0a7f-f9b0-44cc-942d-56499bf65c66 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:51.877262 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-482d0a7f-f9b0-44cc-942d-56499bf65c66 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661062780f5c45d180a05e402fc7bc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277fa3c89dff47b88894b781ff69fb70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:09:51.885237 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-482d0a7f-f9b0-44cc-942d-56499bf65c66 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/674489a9-05f1-4c27-a967-516c16c992b1" status: 200 len: 1266 microversion: 2.1 time: 0.231162 Jul 05 13:09:51.885891 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 501/1008] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:09:51 2022] GET /compute/v2.1/servers/674489a9-05f1-4c27-a967-516c16c992b1 => generated 1266 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:09:51.954001 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell0:SELECT=2 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:09:51.964507 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-ec9a2ad4-cbf4-4798-a5cf-cac01bb9a150 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Flavor limits 0:0:0 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 13:09:51.964963 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-ec9a2ad4-cbf4-4798-a5cf-cac01bb9a150 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Image limits 0:0:0 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 13:09:51.965458 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-ec9a2ad4-cbf4-4798-a5cf-cac01bb9a150 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Flavor pref 0:0:0 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 13:09:51.965867 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-ec9a2ad4-cbf4-4798-a5cf-cac01bb9a150 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Image pref 0:0:0 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 13:09:51.966301 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-ec9a2ad4-cbf4-4798-a5cf-cac01bb9a150 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 13:09:51.975055 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ec9a2ad4-cbf4-4798-a5cf-cac01bb9a150 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:51.976551 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ec9a2ad4-cbf4-4798-a5cf-cac01bb9a150 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:51.976551 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ec9a2ad4-cbf4-4798-a5cf-cac01bb9a150 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:51.976792 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ec9a2ad4-cbf4-4798-a5cf-cac01bb9a150 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:51.993790 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.quota [None req-ec9a2ad4-cbf4-4798-a5cf-cac01bb9a150 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Getting quotas for project 8461fdd34eef42d089eb3c3d7d607518. Resources: {'instances', 'cores', 'ram'} {{(pid=118387) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 13:09:51.997623 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.quota [None req-ec9a2ad4-cbf4-4798-a5cf-cac01bb9a150 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Getting quotas for user 3212553bb4ae401d9d56f311c779f035 and project 8461fdd34eef42d089eb3c3d7d607518. Resources: {'instances', 'cores', 'ram'} {{(pid=118387) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 13:09:52.010939 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-ec9a2ad4-cbf4-4798-a5cf-cac01bb9a150 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Going to run 1 instances... {{(pid=118387) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 13:09:52.013435 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-ec9a2ad4-cbf4-4798-a5cf-cac01bb9a150 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] [instance: d5dff892-f278-47cd-806b-5b2364f2c466] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d6134305-a5c0-4d2c-afc8-e54be21f685c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118387) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 13:09:52.142729 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-ec9a2ad4-cbf4-4798-a5cf-cac01bb9a150 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.675004 Jul 05 13:09:52.143751 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 508/1009] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jul 5 13:09:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 05 13:09:52.153432 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-4a492901-bdef-45ce-ba24-02adb375834d tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:09:52.154073 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-4a492901-bdef-45ce-ba24-02adb375834d tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] [instance: d5dff892-f278-47cd-806b-5b2364f2c466] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:09:52.213101 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-4a492901-bdef-45ce-ba24-02adb375834d tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3212553bb4ae401d9d56f311c779f035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8461fdd34eef42d089eb3c3d7d607518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:09:52.220090 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-4a492901-bdef-45ce-ba24-02adb375834d tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] 10.222.0.36 "GET /compute/v2.1/servers/d5dff892-f278-47cd-806b-5b2364f2c466" status: 200 len: 1218 microversion: 2.1 time: 0.070555 Jul 05 13:09:52.221186 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 502/1010] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:09:52 2022] GET /compute/v2.1/servers/d5dff892-f278-47cd-806b-5b2364f2c466 => generated 1218 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:09:52.285821 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-2d2478a9-6dbf-4651-9c37-c95aaa993c20 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:09:52.286487 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-2d2478a9-6dbf-4651-9c37-c95aaa993c20 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:09:52.294734 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2d2478a9-6dbf-4651-9c37-c95aaa993c20 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:52.295299 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2d2478a9-6dbf-4651-9c37-c95aaa993c20 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:52.296262 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2d2478a9-6dbf-4651-9c37-c95aaa993c20 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:52.296831 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2d2478a9-6dbf-4651-9c37-c95aaa993c20 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:52.429747 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-2d2478a9-6dbf-4651-9c37-c95aaa993c20 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:09:52.437246 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-2d2478a9-6dbf-4651-9c37-c95aaa993c20 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25" status: 200 len: 1665 microversion: 2.1 time: 0.155807 Jul 05 13:09:52.437814 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 509/1011] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:09:52 2022] GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 => generated 1665 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:09:52.902614 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-94de473f-ee06-4211-a599-89cf664a0245 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:09:52.903143 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-94de473f-ee06-4211-a599-89cf664a0245 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: 674489a9-05f1-4c27-a967-516c16c992b1] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:09:52.909516 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-94de473f-ee06-4211-a599-89cf664a0245 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:52.913964 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-94de473f-ee06-4211-a599-89cf664a0245 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:52.913964 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-94de473f-ee06-4211-a599-89cf664a0245 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:52.913964 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-94de473f-ee06-4211-a599-89cf664a0245 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:53.046115 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-94de473f-ee06-4211-a599-89cf664a0245 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661062780f5c45d180a05e402fc7bc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277fa3c89dff47b88894b781ff69fb70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:09:53.053726 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-94de473f-ee06-4211-a599-89cf664a0245 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/674489a9-05f1-4c27-a967-516c16c992b1" status: 200 len: 1266 microversion: 2.1 time: 0.154983 Jul 05 13:09:53.054302 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 503/1012] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:09:52 2022] GET /compute/v2.1/servers/674489a9-05f1-4c27-a967-516c16c992b1 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:09:53.237930 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-ea22ddfd-3cf8-4f43-b547-d9a3c1498bde tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:09:53.238485 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-ea22ddfd-3cf8-4f43-b547-d9a3c1498bde tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] [instance: d5dff892-f278-47cd-806b-5b2364f2c466] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:09:53.293285 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-ea22ddfd-3cf8-4f43-b547-d9a3c1498bde tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3212553bb4ae401d9d56f311c779f035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8461fdd34eef42d089eb3c3d7d607518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:09:53.300660 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-ea22ddfd-3cf8-4f43-b547-d9a3c1498bde tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] 10.222.0.36 "GET /compute/v2.1/servers/d5dff892-f278-47cd-806b-5b2364f2c466" status: 200 len: 1218 microversion: 2.1 time: 0.067281 Jul 05 13:09:53.301234 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 510/1013] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:09:53 2022] GET /compute/v2.1/servers/d5dff892-f278-47cd-806b-5b2364f2c466 => generated 1218 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:09:54.071973 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-97dee554-59e3-413e-9c10-43370b94560a tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:09:54.072771 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-97dee554-59e3-413e-9c10-43370b94560a tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: 674489a9-05f1-4c27-a967-516c16c992b1] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:09:54.080376 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-97dee554-59e3-413e-9c10-43370b94560a tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:54.080850 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-97dee554-59e3-413e-9c10-43370b94560a tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:54.082088 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-97dee554-59e3-413e-9c10-43370b94560a tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:54.082423 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-97dee554-59e3-413e-9c10-43370b94560a tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:54.223441 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-97dee554-59e3-413e-9c10-43370b94560a tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661062780f5c45d180a05e402fc7bc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277fa3c89dff47b88894b781ff69fb70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:09:54.230893 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-97dee554-59e3-413e-9c10-43370b94560a tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/674489a9-05f1-4c27-a967-516c16c992b1" status: 200 len: 1266 microversion: 2.1 time: 0.163656 Jul 05 13:09:54.234501 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 504/1014] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:09:54 2022] GET /compute/v2.1/servers/674489a9-05f1-4c27-a967-516c16c992b1 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:09:54.316579 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-e62e2412-535a-460b-a6d3-27f5e231b3ae tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:09:54.322261 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-e62e2412-535a-460b-a6d3-27f5e231b3ae tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] [instance: d5dff892-f278-47cd-806b-5b2364f2c466] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:09:54.324611 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e62e2412-535a-460b-a6d3-27f5e231b3ae tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:54.325064 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e62e2412-535a-460b-a6d3-27f5e231b3ae tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:54.325824 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e62e2412-535a-460b-a6d3-27f5e231b3ae tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:54.326256 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e62e2412-535a-460b-a6d3-27f5e231b3ae tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:54.386532 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-e62e2412-535a-460b-a6d3-27f5e231b3ae tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3212553bb4ae401d9d56f311c779f035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8461fdd34eef42d089eb3c3d7d607518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:09:54.393919 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-e62e2412-535a-460b-a6d3-27f5e231b3ae tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] 10.222.0.36 "GET /compute/v2.1/servers/d5dff892-f278-47cd-806b-5b2364f2c466" status: 200 len: 1270 microversion: 2.1 time: 0.081302 Jul 05 13:09:54.394474 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 511/1015] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:09:54 2022] GET /compute/v2.1/servers/d5dff892-f278-47cd-806b-5b2364f2c466 => generated 1270 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:09:55.247581 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-1dd90693-52b3-4600-87c9-a81950449c64 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:09:55.248200 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-1dd90693-52b3-4600-87c9-a81950449c64 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: 674489a9-05f1-4c27-a967-516c16c992b1] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:09:55.254935 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-1dd90693-52b3-4600-87c9-a81950449c64 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:55.255319 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-1dd90693-52b3-4600-87c9-a81950449c64 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:55.256074 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-1dd90693-52b3-4600-87c9-a81950449c64 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:55.256507 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-1dd90693-52b3-4600-87c9-a81950449c64 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:55.388251 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-1dd90693-52b3-4600-87c9-a81950449c64 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661062780f5c45d180a05e402fc7bc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277fa3c89dff47b88894b781ff69fb70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:09:55.396214 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-1dd90693-52b3-4600-87c9-a81950449c64 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/674489a9-05f1-4c27-a967-516c16c992b1" status: 200 len: 1266 microversion: 2.1 time: 0.152576 Jul 05 13:09:55.396815 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 505/1016] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:09:55 2022] GET /compute/v2.1/servers/674489a9-05f1-4c27-a967-516c16c992b1 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:09:55.411733 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-cfa6860f-f0c8-427a-899b-49cbbfb53457 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:09:55.412359 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-cfa6860f-f0c8-427a-899b-49cbbfb53457 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] [instance: d5dff892-f278-47cd-806b-5b2364f2c466] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:09:55.418867 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cfa6860f-f0c8-427a-899b-49cbbfb53457 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:55.419349 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cfa6860f-f0c8-427a-899b-49cbbfb53457 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:55.420129 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cfa6860f-f0c8-427a-899b-49cbbfb53457 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:55.420572 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cfa6860f-f0c8-427a-899b-49cbbfb53457 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:55.550571 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-cfa6860f-f0c8-427a-899b-49cbbfb53457 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3212553bb4ae401d9d56f311c779f035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8461fdd34eef42d089eb3c3d7d607518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:09:55.558058 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-cfa6860f-f0c8-427a-899b-49cbbfb53457 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] 10.222.0.36 "GET /compute/v2.1/servers/d5dff892-f278-47cd-806b-5b2364f2c466" status: 200 len: 1318 microversion: 2.1 time: 0.151211 Jul 05 13:09:55.558626 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 512/1017] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:09:55 2022] GET /compute/v2.1/servers/d5dff892-f278-47cd-806b-5b2364f2c466 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:09:56.412624 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-3ef9a468-7c4c-495f-9766-64343f59d184 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:09:56.413255 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-3ef9a468-7c4c-495f-9766-64343f59d184 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: 674489a9-05f1-4c27-a967-516c16c992b1] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:09:56.419595 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-3ef9a468-7c4c-495f-9766-64343f59d184 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:56.420096 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-3ef9a468-7c4c-495f-9766-64343f59d184 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:56.420889 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-3ef9a468-7c4c-495f-9766-64343f59d184 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:56.421325 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-3ef9a468-7c4c-495f-9766-64343f59d184 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:56.453874 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-116d5791-a5d3-4fe3-8cc2-a958d948aae9 req-eb6da6ff-4504-43e7-aebe-486d213a8ea0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5dff892-f278-47cd-806b-5b2364f2c466", "tag": "82d54252-b596-40e2-981a-dbfa824c818c"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:09:56.475262 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-116d5791-a5d3-4fe3-8cc2-a958d948aae9 req-eb6da6ff-4504-43e7-aebe-486d213a8ea0 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:56.475713 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-116d5791-a5d3-4fe3-8cc2-a958d948aae9 req-eb6da6ff-4504-43e7-aebe-486d213a8ea0 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:56.493785 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-116d5791-a5d3-4fe3-8cc2-a958d948aae9 req-eb6da6ff-4504-43e7-aebe-486d213a8ea0 service nova] Creating event network-changed:82d54252-b596-40e2-981a-dbfa824c818c for instance d5dff892-f278-47cd-806b-5b2364f2c466 on hv-cinder-79760 Jul 05 13:09:56.512751 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-116d5791-a5d3-4fe3-8cc2-a958d948aae9 req-eb6da6ff-4504-43e7-aebe-486d213a8ea0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048887 Jul 05 13:09:56.512751 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 513/1018] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:09:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:09:56.564405 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-3ef9a468-7c4c-495f-9766-64343f59d184 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661062780f5c45d180a05e402fc7bc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277fa3c89dff47b88894b781ff69fb70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:09:56.571921 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-3ef9a468-7c4c-495f-9766-64343f59d184 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/674489a9-05f1-4c27-a967-516c16c992b1" status: 200 len: 1266 microversion: 2.1 time: 0.163194 Jul 05 13:09:56.572479 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 506/1019] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:09:56 2022] GET /compute/v2.1/servers/674489a9-05f1-4c27-a967-516c16c992b1 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:09:56.575311 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-f839b631-cbb0-44fd-a736-59e24b163482 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:09:56.576012 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-f839b631-cbb0-44fd-a736-59e24b163482 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] [instance: d5dff892-f278-47cd-806b-5b2364f2c466] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:09:56.582770 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f839b631-cbb0-44fd-a736-59e24b163482 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:56.583226 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f839b631-cbb0-44fd-a736-59e24b163482 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:56.583996 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f839b631-cbb0-44fd-a736-59e24b163482 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:56.584434 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f839b631-cbb0-44fd-a736-59e24b163482 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:56.717372 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-f839b631-cbb0-44fd-a736-59e24b163482 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3212553bb4ae401d9d56f311c779f035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8461fdd34eef42d089eb3c3d7d607518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:09:56.725440 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-f839b631-cbb0-44fd-a736-59e24b163482 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] 10.222.0.36 "GET /compute/v2.1/servers/d5dff892-f278-47cd-806b-5b2364f2c466" status: 200 len: 1318 microversion: 2.1 time: 0.154255 Jul 05 13:09:56.729754 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 514/1020] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:09:56 2022] GET /compute/v2.1/servers/d5dff892-f278-47cd-806b-5b2364f2c466 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:09:57.588027 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-5a97cad4-e2ab-4782-a246-2cd773c46c3f tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:09:57.588561 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-5a97cad4-e2ab-4782-a246-2cd773c46c3f tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: 674489a9-05f1-4c27-a967-516c16c992b1] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:09:57.594943 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-5a97cad4-e2ab-4782-a246-2cd773c46c3f tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:57.595408 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-5a97cad4-e2ab-4782-a246-2cd773c46c3f tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:57.596155 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-5a97cad4-e2ab-4782-a246-2cd773c46c3f tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:57.596600 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-5a97cad4-e2ab-4782-a246-2cd773c46c3f tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:57.725329 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-5a97cad4-e2ab-4782-a246-2cd773c46c3f tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661062780f5c45d180a05e402fc7bc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277fa3c89dff47b88894b781ff69fb70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:09:57.733085 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-5a97cad4-e2ab-4782-a246-2cd773c46c3f tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/674489a9-05f1-4c27-a967-516c16c992b1" status: 200 len: 1266 microversion: 2.1 time: 0.149000 Jul 05 13:09:57.733651 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 507/1021] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:09:57 2022] GET /compute/v2.1/servers/674489a9-05f1-4c27-a967-516c16c992b1 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:09:57.742087 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-fe8ce75a-f8fc-4e90-b4ef-f6ed97072ed1 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:09:57.742703 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-fe8ce75a-f8fc-4e90-b4ef-f6ed97072ed1 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] [instance: d5dff892-f278-47cd-806b-5b2364f2c466] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:09:57.749103 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-fe8ce75a-f8fc-4e90-b4ef-f6ed97072ed1 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:57.749547 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-fe8ce75a-f8fc-4e90-b4ef-f6ed97072ed1 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:57.750298 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-fe8ce75a-f8fc-4e90-b4ef-f6ed97072ed1 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:57.750729 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-fe8ce75a-f8fc-4e90-b4ef-f6ed97072ed1 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:57.882113 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-fe8ce75a-f8fc-4e90-b4ef-f6ed97072ed1 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3212553bb4ae401d9d56f311c779f035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8461fdd34eef42d089eb3c3d7d607518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:09:57.889602 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-fe8ce75a-f8fc-4e90-b4ef-f6ed97072ed1 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] 10.222.0.36 "GET /compute/v2.1/servers/d5dff892-f278-47cd-806b-5b2364f2c466" status: 200 len: 1318 microversion: 2.1 time: 0.151374 Jul 05 13:09:57.890172 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 515/1022] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:09:57 2022] GET /compute/v2.1/servers/d5dff892-f278-47cd-806b-5b2364f2c466 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:09:58.750900 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-62d8cd72-2d0a-455b-8868-24e29d77b80e tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:09:58.751470 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-62d8cd72-2d0a-455b-8868-24e29d77b80e tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: 674489a9-05f1-4c27-a967-516c16c992b1] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:09:58.754317 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:09:58.759012 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-62d8cd72-2d0a-455b-8868-24e29d77b80e tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:58.759449 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-62d8cd72-2d0a-455b-8868-24e29d77b80e tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:58.760195 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-62d8cd72-2d0a-455b-8868-24e29d77b80e tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:58.760638 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-62d8cd72-2d0a-455b-8868-24e29d77b80e tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:58.887228 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-62d8cd72-2d0a-455b-8868-24e29d77b80e tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661062780f5c45d180a05e402fc7bc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277fa3c89dff47b88894b781ff69fb70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:09:58.895314 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-62d8cd72-2d0a-455b-8868-24e29d77b80e tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/674489a9-05f1-4c27-a967-516c16c992b1" status: 200 len: 1266 microversion: 2.1 time: 0.148291 Jul 05 13:09:58.895888 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 508/1023] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:09:58 2022] GET /compute/v2.1/servers/674489a9-05f1-4c27-a967-516c16c992b1 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:09:58.905491 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-8a8c3e31-a594-4269-9277-89535e471ab0 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:09:58.910555 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-8a8c3e31-a594-4269-9277-89535e471ab0 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] [instance: d5dff892-f278-47cd-806b-5b2364f2c466] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:09:58.912316 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8a8c3e31-a594-4269-9277-89535e471ab0 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:58.912884 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8a8c3e31-a594-4269-9277-89535e471ab0 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:58.913655 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8a8c3e31-a594-4269-9277-89535e471ab0 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:58.914090 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8a8c3e31-a594-4269-9277-89535e471ab0 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:59.042305 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-8a8c3e31-a594-4269-9277-89535e471ab0 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3212553bb4ae401d9d56f311c779f035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8461fdd34eef42d089eb3c3d7d607518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:09:59.049568 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-8a8c3e31-a594-4269-9277-89535e471ab0 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] 10.222.0.36 "GET /compute/v2.1/servers/d5dff892-f278-47cd-806b-5b2364f2c466" status: 200 len: 1318 microversion: 2.1 time: 0.147930 Jul 05 13:09:59.050146 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 516/1024] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:09:58 2022] GET /compute/v2.1/servers/d5dff892-f278-47cd-806b-5b2364f2c466 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:09:59.911404 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-85592511-4df4-41f7-99a5-43f0ab4d7c71 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:09:59.912006 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-85592511-4df4-41f7-99a5-43f0ab4d7c71 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: 674489a9-05f1-4c27-a967-516c16c992b1] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:09:59.920497 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-85592511-4df4-41f7-99a5-43f0ab4d7c71 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:59.921353 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-85592511-4df4-41f7-99a5-43f0ab4d7c71 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:09:59.921943 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-85592511-4df4-41f7-99a5-43f0ab4d7c71 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:09:59.922390 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-85592511-4df4-41f7-99a5-43f0ab4d7c71 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:00.057664 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-85592511-4df4-41f7-99a5-43f0ab4d7c71 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661062780f5c45d180a05e402fc7bc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277fa3c89dff47b88894b781ff69fb70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:10:00.065969 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-85592511-4df4-41f7-99a5-43f0ab4d7c71 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/674489a9-05f1-4c27-a967-516c16c992b1" status: 200 len: 1266 microversion: 2.1 time: 0.158513 Jul 05 13:10:00.066988 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 509/1025] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:09:59 2022] GET /compute/v2.1/servers/674489a9-05f1-4c27-a967-516c16c992b1 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:10:00.067128 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-cc118b34-f0df-4937-b542-208eabb8261e tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:10:00.067661 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-cc118b34-f0df-4937-b542-208eabb8261e tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] [instance: d5dff892-f278-47cd-806b-5b2364f2c466] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:10:00.074474 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cc118b34-f0df-4937-b542-208eabb8261e tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:00.074943 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cc118b34-f0df-4937-b542-208eabb8261e tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:00.075751 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cc118b34-f0df-4937-b542-208eabb8261e tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:00.076195 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cc118b34-f0df-4937-b542-208eabb8261e tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:00.203223 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-cc118b34-f0df-4937-b542-208eabb8261e tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3212553bb4ae401d9d56f311c779f035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8461fdd34eef42d089eb3c3d7d607518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:10:00.210842 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-cc118b34-f0df-4937-b542-208eabb8261e tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] 10.222.0.36 "GET /compute/v2.1/servers/d5dff892-f278-47cd-806b-5b2364f2c466" status: 200 len: 1318 microversion: 2.1 time: 0.148442 Jul 05 13:10:00.211409 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 517/1026] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:10:00 2022] GET /compute/v2.1/servers/d5dff892-f278-47cd-806b-5b2364f2c466 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:10:01.083762 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-9f05a74c-e27b-45a5-8b29-31af02fcd26c tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:10:01.084379 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-9f05a74c-e27b-45a5-8b29-31af02fcd26c tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: 674489a9-05f1-4c27-a967-516c16c992b1] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:10:01.090811 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-9f05a74c-e27b-45a5-8b29-31af02fcd26c tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:01.091256 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-9f05a74c-e27b-45a5-8b29-31af02fcd26c tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:01.092013 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-9f05a74c-e27b-45a5-8b29-31af02fcd26c tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:01.092442 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-9f05a74c-e27b-45a5-8b29-31af02fcd26c tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:01.226946 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-9f05a74c-e27b-45a5-8b29-31af02fcd26c tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661062780f5c45d180a05e402fc7bc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277fa3c89dff47b88894b781ff69fb70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:10:01.227334 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-113940d3-61be-41bf-86f5-7f3f39735fd1 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:10:01.228077 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-113940d3-61be-41bf-86f5-7f3f39735fd1 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] [instance: d5dff892-f278-47cd-806b-5b2364f2c466] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:10:01.230537 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=6 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:10:01.235272 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-9f05a74c-e27b-45a5-8b29-31af02fcd26c tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/674489a9-05f1-4c27-a967-516c16c992b1" status: 200 len: 1266 microversion: 2.1 time: 0.155915 Jul 05 13:10:01.235540 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-113940d3-61be-41bf-86f5-7f3f39735fd1 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:01.241126 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 510/1027] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:10:01 2022] GET /compute/v2.1/servers/674489a9-05f1-4c27-a967-516c16c992b1 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:10:01.248273 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-113940d3-61be-41bf-86f5-7f3f39735fd1 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:01.248273 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-113940d3-61be-41bf-86f5-7f3f39735fd1 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:01.248273 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-113940d3-61be-41bf-86f5-7f3f39735fd1 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:01.365949 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-113940d3-61be-41bf-86f5-7f3f39735fd1 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3212553bb4ae401d9d56f311c779f035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8461fdd34eef42d089eb3c3d7d607518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:10:01.373786 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-113940d3-61be-41bf-86f5-7f3f39735fd1 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] 10.222.0.36 "GET /compute/v2.1/servers/d5dff892-f278-47cd-806b-5b2364f2c466" status: 200 len: 1318 microversion: 2.1 time: 0.150336 Jul 05 13:10:01.374342 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 518/1028] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:10:01 2022] GET /compute/v2.1/servers/d5dff892-f278-47cd-806b-5b2364f2c466 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:10:01.715971 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [req-33676193-5b6b-414d-9bb4-898b6da8cc33 req-bf545d3a-6afe-4cd4-a2c8-ac6587bf0aa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "674489a9-05f1-4c27-a967-516c16c992b1", "name": "network-vif-plugged", "status": "completed", "tag": "c9bcf6d5-2b90-4b96-80fa-89a15cf69f8c"}]} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:10:01.724774 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-33676193-5b6b-414d-9bb4-898b6da8cc33 req-bf545d3a-6afe-4cd4-a2c8-ac6587bf0aa7 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:01.725006 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-33676193-5b6b-414d-9bb4-898b6da8cc33 req-bf545d3a-6afe-4cd4-a2c8-ac6587bf0aa7 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:01.735852 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.compute.server_external_events [req-33676193-5b6b-414d-9bb4-898b6da8cc33 req-bf545d3a-6afe-4cd4-a2c8-ac6587bf0aa7 service nova] Creating event network-vif-plugged:c9bcf6d5-2b90-4b96-80fa-89a15cf69f8c for instance 674489a9-05f1-4c27-a967-516c16c992b1 on hv-cinder-79760 Jul 05 13:10:01.741529 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [req-33676193-5b6b-414d-9bb4-898b6da8cc33 req-bf545d3a-6afe-4cd4-a2c8-ac6587bf0aa7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029332 Jul 05 13:10:01.742346 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 511/1029] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:10:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:10:02.251438 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-deae785a-e016-406b-88f2-664527316495 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:10:02.252266 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-deae785a-e016-406b-88f2-664527316495 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: 674489a9-05f1-4c27-a967-516c16c992b1] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:10:02.254230 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell0:SELECT=2 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:10:02.259594 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-deae785a-e016-406b-88f2-664527316495 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:02.260044 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-deae785a-e016-406b-88f2-664527316495 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:02.260835 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-deae785a-e016-406b-88f2-664527316495 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:02.261274 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-deae785a-e016-406b-88f2-664527316495 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:02.391946 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-5bcda9d2-9756-4fc3-9086-b6c3b6972c82 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:10:02.392688 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-5bcda9d2-9756-4fc3-9086-b6c3b6972c82 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] [instance: d5dff892-f278-47cd-806b-5b2364f2c466] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:10:02.396815 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_cell0:SELECT=6 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:10:02.400540 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-5bcda9d2-9756-4fc3-9086-b6c3b6972c82 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:02.400715 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-deae785a-e016-406b-88f2-664527316495 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661062780f5c45d180a05e402fc7bc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277fa3c89dff47b88894b781ff69fb70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:10:02.401053 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-5bcda9d2-9756-4fc3-9086-b6c3b6972c82 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:02.401823 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-5bcda9d2-9756-4fc3-9086-b6c3b6972c82 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:02.402257 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-5bcda9d2-9756-4fc3-9086-b6c3b6972c82 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:02.408685 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-deae785a-e016-406b-88f2-664527316495 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/674489a9-05f1-4c27-a967-516c16c992b1" status: 200 len: 1266 microversion: 2.1 time: 0.161096 Jul 05 13:10:02.409944 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 519/1030] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:10:02 2022] GET /compute/v2.1/servers/674489a9-05f1-4c27-a967-516c16c992b1 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:10:02.421133 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:10:02.531946 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-5bcda9d2-9756-4fc3-9086-b6c3b6972c82 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3212553bb4ae401d9d56f311c779f035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8461fdd34eef42d089eb3c3d7d607518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:10:02.539346 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-5bcda9d2-9756-4fc3-9086-b6c3b6972c82 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] 10.222.0.36 "GET /compute/v2.1/servers/d5dff892-f278-47cd-806b-5b2364f2c466" status: 200 len: 1318 microversion: 2.1 time: 0.151773 Jul 05 13:10:02.539919 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 512/1031] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:10:02 2022] GET /compute/v2.1/servers/d5dff892-f278-47cd-806b-5b2364f2c466 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:10:03.426561 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-911a9551-5233-463c-81d1-8ac88133effc tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:10:03.427200 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-911a9551-5233-463c-81d1-8ac88133effc tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: 674489a9-05f1-4c27-a967-516c16c992b1] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:10:03.429807 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell0:SELECT=14 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:10:03.434718 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-911a9551-5233-463c-81d1-8ac88133effc tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:03.435187 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-911a9551-5233-463c-81d1-8ac88133effc tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:03.436003 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-911a9551-5233-463c-81d1-8ac88133effc tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:03.436449 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-911a9551-5233-463c-81d1-8ac88133effc tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:03.556207 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-d4e5dcf7-f1ff-4ed9-8044-a315cd146ef0 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:10:03.556853 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-d4e5dcf7-f1ff-4ed9-8044-a315cd146ef0 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] [instance: d5dff892-f278-47cd-806b-5b2364f2c466] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:10:03.564253 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-d4e5dcf7-f1ff-4ed9-8044-a315cd146ef0 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:03.564726 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-d4e5dcf7-f1ff-4ed9-8044-a315cd146ef0 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:03.565496 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-d4e5dcf7-f1ff-4ed9-8044-a315cd146ef0 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:03.565727 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-911a9551-5233-463c-81d1-8ac88133effc tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661062780f5c45d180a05e402fc7bc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277fa3c89dff47b88894b781ff69fb70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:10:03.565934 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-d4e5dcf7-f1ff-4ed9-8044-a315cd146ef0 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:03.573284 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-911a9551-5233-463c-81d1-8ac88133effc tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/674489a9-05f1-4c27-a967-516c16c992b1" status: 200 len: 1266 microversion: 2.1 time: 0.151268 Jul 05 13:10:03.577926 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 520/1032] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:10:03 2022] GET /compute/v2.1/servers/674489a9-05f1-4c27-a967-516c16c992b1 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:10:03.702191 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-d4e5dcf7-f1ff-4ed9-8044-a315cd146ef0 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3212553bb4ae401d9d56f311c779f035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8461fdd34eef42d089eb3c3d7d607518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:10:03.709501 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-d4e5dcf7-f1ff-4ed9-8044-a315cd146ef0 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] 10.222.0.36 "GET /compute/v2.1/servers/d5dff892-f278-47cd-806b-5b2364f2c466" status: 200 len: 1318 microversion: 2.1 time: 0.157534 Jul 05 13:10:03.710076 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 513/1033] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:10:03 2022] GET /compute/v2.1/servers/d5dff892-f278-47cd-806b-5b2364f2c466 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:10:03.756820 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-c1af232c-ea6f-40d3-812c-bf79989c4d05 req-ce579362-c72b-4f83-a888-cff9dba47753 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5dff892-f278-47cd-806b-5b2364f2c466", "name": "network-vif-plugged", "status": "completed", "tag": "82d54252-b596-40e2-981a-dbfa824c818c"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:10:03.765093 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-c1af232c-ea6f-40d3-812c-bf79989c4d05 req-ce579362-c72b-4f83-a888-cff9dba47753 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:03.765536 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-c1af232c-ea6f-40d3-812c-bf79989c4d05 req-ce579362-c72b-4f83-a888-cff9dba47753 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:03.777153 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-c1af232c-ea6f-40d3-812c-bf79989c4d05 req-ce579362-c72b-4f83-a888-cff9dba47753 service nova] Creating event network-vif-plugged:82d54252-b596-40e2-981a-dbfa824c818c for instance d5dff892-f278-47cd-806b-5b2364f2c466 on hv-cinder-79760 Jul 05 13:10:03.782283 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-c1af232c-ea6f-40d3-812c-bf79989c4d05 req-ce579362-c72b-4f83-a888-cff9dba47753 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029871 Jul 05 13:10:03.783013 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 521/1034] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:10:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:10:04.590564 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-bcc307f5-5bc4-428b-8820-00636d9d18fd tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:10:04.591198 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-bcc307f5-5bc4-428b-8820-00636d9d18fd tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: 674489a9-05f1-4c27-a967-516c16c992b1] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:10:04.598040 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-bcc307f5-5bc4-428b-8820-00636d9d18fd tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:04.598481 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-bcc307f5-5bc4-428b-8820-00636d9d18fd tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:04.599230 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-bcc307f5-5bc4-428b-8820-00636d9d18fd tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:04.599660 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-bcc307f5-5bc4-428b-8820-00636d9d18fd tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:04.727605 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-bcc307f5-5bc4-428b-8820-00636d9d18fd tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661062780f5c45d180a05e402fc7bc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277fa3c89dff47b88894b781ff69fb70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:10:04.727851 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-c8bb396f-f4bd-4553-b2ad-3ab03740e83e tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:10:04.728638 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-c8bb396f-f4bd-4553-b2ad-3ab03740e83e tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] [instance: d5dff892-f278-47cd-806b-5b2364f2c466] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:10:04.735928 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c8bb396f-f4bd-4553-b2ad-3ab03740e83e tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:04.736383 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c8bb396f-f4bd-4553-b2ad-3ab03740e83e tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:04.736572 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-bcc307f5-5bc4-428b-8820-00636d9d18fd tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/674489a9-05f1-4c27-a967-516c16c992b1" status: 200 len: 1454 microversion: 2.1 time: 0.149803 Jul 05 13:10:04.737352 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 514/1035] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:10:04 2022] GET /compute/v2.1/servers/674489a9-05f1-4c27-a967-516c16c992b1 => generated 1454 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:10:04.737498 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c8bb396f-f4bd-4553-b2ad-3ab03740e83e tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:04.737607 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c8bb396f-f4bd-4553-b2ad-3ab03740e83e tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:04.753074 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-c6ffda35-66d2-42b6-8b86-79b5c1ceb10c tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:10:04.753723 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-c6ffda35-66d2-42b6-8b86-79b5c1ceb10c tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: 674489a9-05f1-4c27-a967-516c16c992b1] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:10:04.761414 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-c6ffda35-66d2-42b6-8b86-79b5c1ceb10c tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:04.761905 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-c6ffda35-66d2-42b6-8b86-79b5c1ceb10c tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:04.762733 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-c6ffda35-66d2-42b6-8b86-79b5c1ceb10c tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:04.763164 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-c6ffda35-66d2-42b6-8b86-79b5c1ceb10c tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:04.938779 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-c6ffda35-66d2-42b6-8b86-79b5c1ceb10c tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661062780f5c45d180a05e402fc7bc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277fa3c89dff47b88894b781ff69fb70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:10:04.941807 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-c8bb396f-f4bd-4553-b2ad-3ab03740e83e tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3212553bb4ae401d9d56f311c779f035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8461fdd34eef42d089eb3c3d7d607518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:10:04.946367 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-c6ffda35-66d2-42b6-8b86-79b5c1ceb10c tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/674489a9-05f1-4c27-a967-516c16c992b1" status: 200 len: 1454 microversion: 2.1 time: 0.196987 Jul 05 13:10:04.947136 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 515/1036] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:10:04 2022] GET /compute/v2.1/servers/674489a9-05f1-4c27-a967-516c16c992b1 => generated 1454 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:10:04.949251 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-c8bb396f-f4bd-4553-b2ad-3ab03740e83e tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] 10.222.0.36 "GET /compute/v2.1/servers/d5dff892-f278-47cd-806b-5b2364f2c466" status: 200 len: 1318 microversion: 2.1 time: 0.226815 Jul 05 13:10:04.949809 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 522/1037] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:10:04 2022] GET /compute/v2.1/servers/d5dff892-f278-47cd-806b-5b2364f2c466 => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:10:05.966477 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-73424f43-64f7-4fae-9909-7f5a50fc29b1 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:10:05.967083 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-73424f43-64f7-4fae-9909-7f5a50fc29b1 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] [instance: d5dff892-f278-47cd-806b-5b2364f2c466] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:10:05.974911 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-73424f43-64f7-4fae-9909-7f5a50fc29b1 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:05.979360 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-73424f43-64f7-4fae-9909-7f5a50fc29b1 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:05.979360 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-73424f43-64f7-4fae-9909-7f5a50fc29b1 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:05.979360 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-73424f43-64f7-4fae-9909-7f5a50fc29b1 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:06.116094 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-73424f43-64f7-4fae-9909-7f5a50fc29b1 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3212553bb4ae401d9d56f311c779f035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8461fdd34eef42d089eb3c3d7d607518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:10:06.123930 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-73424f43-64f7-4fae-9909-7f5a50fc29b1 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] 10.222.0.36 "GET /compute/v2.1/servers/d5dff892-f278-47cd-806b-5b2364f2c466" status: 200 len: 1508 microversion: 2.1 time: 0.162109 Jul 05 13:10:06.124516 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 516/1038] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:10:05 2022] GET /compute/v2.1/servers/d5dff892-f278-47cd-806b-5b2364f2c466 => generated 1508 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:10:06.140515 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-94e42aab-bd9b-4230-b57d-f6c98a6c3259 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "58ace277-26ca-4b9a-9009-25d09d4cbd6c", "device": "/dev/sdb"}} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:10:06.141668 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-94e42aab-bd9b-4230-b57d-f6c98a6c3259 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] [instance: d5dff892-f278-47cd-806b-5b2364f2c466] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:10:06.148284 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-94e42aab-bd9b-4230-b57d-f6c98a6c3259 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:06.148770 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-94e42aab-bd9b-4230-b57d-f6c98a6c3259 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:06.149541 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-94e42aab-bd9b-4230-b57d-f6c98a6c3259 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:06.150170 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-94e42aab-bd9b-4230-b57d-f6c98a6c3259 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:06.729994 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:10:06.901826 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [req-cb8c93f8-6b69-437e-954b-e1a088b9aedf req-edafc0e5-f341-4aaa-a38a-d71da3910b18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "674489a9-05f1-4c27-a967-516c16c992b1", "tag": "c9bcf6d5-2b90-4b96-80fa-89a15cf69f8c"}]} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:10:06.910924 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-cb8c93f8-6b69-437e-954b-e1a088b9aedf req-edafc0e5-f341-4aaa-a38a-d71da3910b18 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:06.911363 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-cb8c93f8-6b69-437e-954b-e1a088b9aedf req-edafc0e5-f341-4aaa-a38a-d71da3910b18 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:06.922687 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.compute.server_external_events [req-cb8c93f8-6b69-437e-954b-e1a088b9aedf req-edafc0e5-f341-4aaa-a38a-d71da3910b18 service nova] Creating event network-changed:c9bcf6d5-2b90-4b96-80fa-89a15cf69f8c for instance 674489a9-05f1-4c27-a967-516c16c992b1 on hv-cinder-79760 Jul 05 13:10:06.928614 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [req-cb8c93f8-6b69-437e-954b-e1a088b9aedf req-edafc0e5-f341-4aaa-a38a-d71da3910b18 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030582 Jul 05 13:10:06.929209 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 517/1039] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 13:10:06.944021 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-94e42aab-bd9b-4230-b57d-f6c98a6c3259 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] 10.222.0.36 "POST /compute/v2.1/servers/d5dff892-f278-47cd-806b-5b2364f2c466/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.807075 Jul 05 13:10:06.948911 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 523/1040] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Jul 5 13:10:06 2022] POST /compute/v2.1/servers/d5dff892-f278-47cd-806b-5b2364f2c466/os-volume_attachments => generated 194 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:10:26.925468 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_api:SELECT=19 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:10:26.926201 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_cell1:SELECT=28 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:10:26.930283 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-913e7d01-177e-4553-af4d-95b2e9b78356 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:10:26.930856 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-913e7d01-177e-4553-af4d-95b2e9b78356 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] [instance: d5dff892-f278-47cd-806b-5b2364f2c466] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:10:26.936789 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-913e7d01-177e-4553-af4d-95b2e9b78356 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:26.943509 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-913e7d01-177e-4553-af4d-95b2e9b78356 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:26.943509 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-913e7d01-177e-4553-af4d-95b2e9b78356 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:26.943509 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-913e7d01-177e-4553-af4d-95b2e9b78356 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:27.022572 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.objects.instance [None req-913e7d01-177e-4553-af4d-95b2e9b78356 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lazy-loading 'services' on Instance uuid d5dff892-f278-47cd-806b-5b2364f2c466 {{(pid=118386) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 13:10:27.214389 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-913e7d01-177e-4553-af4d-95b2e9b78356 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d5dff892-f278-47cd-806b-5b2364f2c466/os-volume_attachments/58ace277-26ca-4b9a-9009-25d09d4cbd6c" status: 202 len: 0 microversion: 2.1 time: 0.290241 Jul 05 13:10:27.214935 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 518/1041] 10.222.0.36 () {58 vars in 1415 bytes} [Tue Jul 5 13:10:26 2022] DELETE /compute/v2.1/servers/d5dff892-f278-47cd-806b-5b2364f2c466/os-volume_attachments/58ace277-26ca-4b9a-9009-25d09d4cbd6c => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 13:10:28.330658 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-151e8151-3bff-47d8-af5d-06463c8bbdeb tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:10:28.331462 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-151e8151-3bff-47d8-af5d-06463c8bbdeb tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] [instance: d5dff892-f278-47cd-806b-5b2364f2c466] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:10:28.334296 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_api:SELECT=11 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:10:28.340878 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-151e8151-3bff-47d8-af5d-06463c8bbdeb tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:28.341725 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-151e8151-3bff-47d8-af5d-06463c8bbdeb tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:28.342560 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-151e8151-3bff-47d8-af5d-06463c8bbdeb tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:28.343117 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-151e8151-3bff-47d8-af5d-06463c8bbdeb tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:28.377034 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-151e8151-3bff-47d8-af5d-06463c8bbdeb tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] [instance: d5dff892-f278-47cd-806b-5b2364f2c466] Going to try to terminate instance {{(pid=118387) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 13:10:28.721783 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-151e8151-3bff-47d8-af5d-06463c8bbdeb tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d5dff892-f278-47cd-806b-5b2364f2c466" status: 204 len: 0 microversion: 2.1 time: 0.395545 Jul 05 13:10:28.722386 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 524/1042] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jul 5 13:10:28 2022] DELETE /compute/v2.1/servers/d5dff892-f278-47cd-806b-5b2364f2c466 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 05 13:10:28.732252 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-8bf15eb4-16e0-48b4-9a10-889a6a02de99 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:10:28.735655 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-8bf15eb4-16e0-48b4-9a10-889a6a02de99 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] [instance: d5dff892-f278-47cd-806b-5b2364f2c466] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:10:28.739357 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-8bf15eb4-16e0-48b4-9a10-889a6a02de99 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:28.739801 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-8bf15eb4-16e0-48b4-9a10-889a6a02de99 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:28.740556 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-8bf15eb4-16e0-48b4-9a10-889a6a02de99 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:28.741018 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-8bf15eb4-16e0-48b4-9a10-889a6a02de99 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:28.870912 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-8bf15eb4-16e0-48b4-9a10-889a6a02de99 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3212553bb4ae401d9d56f311c779f035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8461fdd34eef42d089eb3c3d7d607518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:10:28.878427 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-8bf15eb4-16e0-48b4-9a10-889a6a02de99 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] 10.222.0.36 "GET /compute/v2.1/servers/d5dff892-f278-47cd-806b-5b2364f2c466" status: 200 len: 1514 microversion: 2.1 time: 0.151025 Jul 05 13:10:28.878986 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 519/1043] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:10:28 2022] GET /compute/v2.1/servers/d5dff892-f278-47cd-806b-5b2364f2c466 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:10:29.896077 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-cf74dc3a-46ed-47ce-a625-120d387f400e tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:10:29.896714 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-cf74dc3a-46ed-47ce-a625-120d387f400e tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] [instance: d5dff892-f278-47cd-806b-5b2364f2c466] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:10:29.903168 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cf74dc3a-46ed-47ce-a625-120d387f400e tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:29.903608 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cf74dc3a-46ed-47ce-a625-120d387f400e tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:29.904406 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cf74dc3a-46ed-47ce-a625-120d387f400e tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:29.904866 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cf74dc3a-46ed-47ce-a625-120d387f400e tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:30.038590 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-cf74dc3a-46ed-47ce-a625-120d387f400e tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3212553bb4ae401d9d56f311c779f035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8461fdd34eef42d089eb3c3d7d607518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:10:30.046055 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-cf74dc3a-46ed-47ce-a625-120d387f400e tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] 10.222.0.36 "GET /compute/v2.1/servers/d5dff892-f278-47cd-806b-5b2364f2c466" status: 200 len: 1514 microversion: 2.1 time: 0.154346 Jul 05 13:10:30.046615 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 525/1044] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:10:29 2022] GET /compute/v2.1/servers/d5dff892-f278-47cd-806b-5b2364f2c466 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:10:31.063451 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-5ab8fd7f-38bf-473e-b793-3be8b808f30e tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:10:31.064161 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-5ab8fd7f-38bf-473e-b793-3be8b808f30e tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] [instance: d5dff892-f278-47cd-806b-5b2364f2c466] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:10:31.070671 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-5ab8fd7f-38bf-473e-b793-3be8b808f30e tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:31.071187 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-5ab8fd7f-38bf-473e-b793-3be8b808f30e tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:31.072020 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-5ab8fd7f-38bf-473e-b793-3be8b808f30e tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:31.072527 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-5ab8fd7f-38bf-473e-b793-3be8b808f30e tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:31.204864 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-5ab8fd7f-38bf-473e-b793-3be8b808f30e tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3212553bb4ae401d9d56f311c779f035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8461fdd34eef42d089eb3c3d7d607518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:10:31.213299 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-5ab8fd7f-38bf-473e-b793-3be8b808f30e tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] 10.222.0.36 "GET /compute/v2.1/servers/d5dff892-f278-47cd-806b-5b2364f2c466" status: 200 len: 1514 microversion: 2.1 time: 0.153816 Jul 05 13:10:31.213994 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 520/1045] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:10:31 2022] GET /compute/v2.1/servers/d5dff892-f278-47cd-806b-5b2364f2c466 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:10:31.277321 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-88555591-8202-4f2f-bef6-fc2a21c593a8 req-ac979a25-ee9b-4204-a811-7d5d598ed907 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5dff892-f278-47cd-806b-5b2364f2c466", "name": "network-vif-deleted", "tag": "82d54252-b596-40e2-981a-dbfa824c818c"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:10:31.285752 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-88555591-8202-4f2f-bef6-fc2a21c593a8 req-ac979a25-ee9b-4204-a811-7d5d598ed907 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:31.286197 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-88555591-8202-4f2f-bef6-fc2a21c593a8 req-ac979a25-ee9b-4204-a811-7d5d598ed907 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:31.296866 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-88555591-8202-4f2f-bef6-fc2a21c593a8 req-ac979a25-ee9b-4204-a811-7d5d598ed907 service nova] Creating event network-vif-deleted:82d54252-b596-40e2-981a-dbfa824c818c for instance d5dff892-f278-47cd-806b-5b2364f2c466 on hv-cinder-79760 Jul 05 13:10:31.301588 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-88555591-8202-4f2f-bef6-fc2a21c593a8 req-ac979a25-ee9b-4204-a811-7d5d598ed907 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027951 Jul 05 13:10:31.302156 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 526/1046] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:10:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 13:10:32.230214 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-9c7046c0-aac1-49bd-a8f5-09e6766d8858 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:10:32.230758 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-9c7046c0-aac1-49bd-a8f5-09e6766d8858 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] [instance: d5dff892-f278-47cd-806b-5b2364f2c466] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:10:32.237945 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-9c7046c0-aac1-49bd-a8f5-09e6766d8858 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:32.238395 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-9c7046c0-aac1-49bd-a8f5-09e6766d8858 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:32.239156 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-9c7046c0-aac1-49bd-a8f5-09e6766d8858 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:32.239591 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-9c7046c0-aac1-49bd-a8f5-09e6766d8858 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:32.270956 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-9c7046c0-aac1-49bd-a8f5-09e6766d8858 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:32.271397 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-9c7046c0-aac1-49bd-a8f5-09e6766d8858 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:32.271845 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.objects.instance [None req-9c7046c0-aac1-49bd-a8f5-09e6766d8858 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lazy-loading 'fault' on Instance uuid d5dff892-f278-47cd-806b-5b2364f2c466 {{(pid=118386) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 13:10:32.317802 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-9c7046c0-aac1-49bd-a8f5-09e6766d8858 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3212553bb4ae401d9d56f311c779f035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8461fdd34eef42d089eb3c3d7d607518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:10:32.327887 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-9c7046c0-aac1-49bd-a8f5-09e6766d8858 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] 10.222.0.36 "GET /compute/v2.1/servers/d5dff892-f278-47cd-806b-5b2364f2c466" status: 200 len: 1308 microversion: 2.1 time: 0.102191 Jul 05 13:10:32.328462 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 521/1047] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:10:32 2022] GET /compute/v2.1/servers/d5dff892-f278-47cd-806b-5b2364f2c466 => generated 1308 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:10:33.349941 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-07d4d7e5-8d0e-4676-9232-cd4db1b92033 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:10:33.351275 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-07d4d7e5-8d0e-4676-9232-cd4db1b92033 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] [instance: d5dff892-f278-47cd-806b-5b2364f2c466] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:10:33.357928 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-07d4d7e5-8d0e-4676-9232-cd4db1b92033 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:33.358371 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-07d4d7e5-8d0e-4676-9232-cd4db1b92033 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:33.359122 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-07d4d7e5-8d0e-4676-9232-cd4db1b92033 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:33.359555 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-07d4d7e5-8d0e-4676-9232-cd4db1b92033 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:33.373578 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.wsgi [None req-07d4d7e5-8d0e-4676-9232-cd4db1b92033 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] HTTP exception thrown: Instance d5dff892-f278-47cd-806b-5b2364f2c466 could not be found. Jul 05 13:10:33.375165 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-07d4d7e5-8d0e-4676-9232-cd4db1b92033 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Request method failure captured: Jul 05 13:10:33.375165 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: request: GET /compute/v2.1/servers/d5dff892-f278-47cd-806b-5b2364f2c466 HTTP/1.1 Jul 05 13:10:33.375165 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept: application/json Jul 05 13:10:33.375165 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept-Encoding: identity Jul 05 13:10:33.375165 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Connection: close Jul 05 13:10:33.375165 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Length: 0 Jul 05 13:10:33.375165 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Type: application/json Jul 05 13:10:33.375165 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Host: 10.222.0.36 Jul 05 13:10:33.375165 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Openstack-System-Scope: None Jul 05 13:10:33.375165 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: User-Agent: python-urllib3/1.26.9 Jul 05 13:10:33.375165 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Auth-Token: gAAAAABixDfOLff87vyYbiC7Yt3kToYC_SrLc2Sow12cIvzWwyjHhb_8NCAKjJRXWJBcMrgllHhlzKGu8oQZTn5C2Ikfp4cGFAbcKxp_XZBEyaUh_E9NTR3ueGBpSPXlXZPbIRrrKYUQlUFA1KOIMu35pL2EkFqq5Ii5jIuuL3KO2ctlb-pvIro Jul 05 13:10:33.375165 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Id: None Jul 05 13:10:33.375165 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Name: None Jul 05 13:10:33.375165 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Identity-Status: Confirmed Jul 05 13:10:33.375165 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Is-Admin-Project: True Jul 05 13:10:33.375165 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Id: default Jul 05 13:10:33.375165 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Name: Default Jul 05 13:10:33.375165 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Id: 8461fdd34eef42d089eb3c3d7d607518 Jul 05 13:10:33.375165 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Name: tempest-VolumesSnapshotTestJSON-838518118 Jul 05 13:10:33.375165 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Role: member,reader Jul 05 13:10:33.375165 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Roles: member,reader Jul 05 13:10:33.376889 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8461fdd34eef42d089eb3c3d7d607518"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8461fdd34eef42d089eb3c3d7d607518", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8461fdd34eef42d089eb3c3d7d607518"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8461fdd34eef42d089eb3c3d7d607518"}]}] Jul 05 13:10:33.376889 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant: tempest-VolumesSnapshotTestJSON-838518118 Jul 05 13:10:33.376889 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Id: 8461fdd34eef42d089eb3c3d7d607518 Jul 05 13:10:33.376889 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-838518118 Jul 05 13:10:33.376889 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User: tempest-VolumesSnapshotTestJSON-838518118-project Jul 05 13:10:33.376889 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Id: default Jul 05 13:10:33.376889 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Name: Default Jul 05 13:10:33.376889 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Id: 3212553bb4ae401d9d56f311c779f035 Jul 05 13:10:33.376889 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Name: tempest-VolumesSnapshotTestJSON-838518118-project Jul 05 13:10:33.376889 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: method: > Jul 05 13:10:33.376889 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: exception: Instance d5dff892-f278-47cd-806b-5b2364f2c466 could not be found. Jul 05 13:10:33.376889 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: action_args: {'id': 'd5dff892-f278-47cd-806b-5b2364f2c466'} Jul 05 13:10:33.377943 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 13:10:33.377943 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:10:33.377943 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 13:10:33.377943 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 13:10:33.377943 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 13:10:33.377943 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 13:10:33.377943 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 13:10:33.377943 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 13:10:33.377943 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 13:10:33.377943 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 13:10:33.377943 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5dff892-f278-47cd-806b-5b2364f2c466 could not be found. Jul 05 13:10:33.377943 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:10:33.377943 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:10:33.377943 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:10:33.377943 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:10:33.377943 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:10:33.377943 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:10:33.377943 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 13:10:33.377943 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 13:10:33.377943 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 13:10:33.379554 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 13:10:33.379554 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 13:10:33.379554 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 13:10:33.379554 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 13:10:33.379554 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 13:10:33.379554 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 13:10:33.379554 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 13:10:33.379554 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5dff892-f278-47cd-806b-5b2364f2c466 could not be found. Jul 05 13:10:33.379554 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:10:33.379554 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:10:33.379554 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:10:33.379554 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:10:33.379554 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:10:33.379554 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:10:33.379554 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 13:10:33.379554 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 13:10:33.379554 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5dff892-f278-47cd-806b-5b2364f2c466 could not be found. Jul 05 13:10:33.379554 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:10:33.381077 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-07d4d7e5-8d0e-4676-9232-cd4db1b92033 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] Returning 404 to user: Instance d5dff892-f278-47cd-806b-5b2364f2c466 could not be found. {{(pid=118387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 13:10:33.381077 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-07d4d7e5-8d0e-4676-9232-cd4db1b92033 tempest-VolumesSnapshotTestJSON-838518118 tempest-VolumesSnapshotTestJSON-838518118-project] 10.222.0.36 "GET /compute/v2.1/servers/d5dff892-f278-47cd-806b-5b2364f2c466" status: 404 len: 111 microversion: 2.1 time: 0.031455 Jul 05 13:10:33.381077 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 527/1048] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:10:33 2022] GET /compute/v2.1/servers/d5dff892-f278-47cd-806b-5b2364f2c466 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 13:10:35.559305 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-4a0ebc43-a125-4571-9c5b-d4a4a5143132 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:10:35.560285 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-4a0ebc43-a125-4571-9c5b-d4a4a5143132 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:10:35.566846 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-4a0ebc43-a125-4571-9c5b-d4a4a5143132 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:35.567295 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-4a0ebc43-a125-4571-9c5b-d4a4a5143132 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:35.568052 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-4a0ebc43-a125-4571-9c5b-d4a4a5143132 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:35.568486 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-4a0ebc43-a125-4571-9c5b-d4a4a5143132 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:35.597657 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-4a0ebc43-a125-4571-9c5b-d4a4a5143132 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042244 Jul 05 13:10:35.598167 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 522/1049] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jul 5 13:10:35 2022] GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 05 13:10:35.654225 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-6503a6f1-1b91-4a8c-81d6-8af16f4ec96c tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:10:35.654738 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-6503a6f1-1b91-4a8c-81d6-8af16f4ec96c tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:10:35.661078 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6503a6f1-1b91-4a8c-81d6-8af16f4ec96c tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:35.661522 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6503a6f1-1b91-4a8c-81d6-8af16f4ec96c tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:35.662269 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6503a6f1-1b91-4a8c-81d6-8af16f4ec96c tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:35.662697 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6503a6f1-1b91-4a8c-81d6-8af16f4ec96c tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:35.688126 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-6503a6f1-1b91-4a8c-81d6-8af16f4ec96c tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Going to try to terminate instance {{(pid=118387) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 13:10:36.014986 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-6503a6f1-1b91-4a8c-81d6-8af16f4ec96c tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25" status: 204 len: 0 microversion: 2.1 time: 0.364173 Jul 05 13:10:36.015551 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 528/1050] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jul 5 13:10:35 2022] DELETE /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 05 13:10:36.024147 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-211e7d5a-f3fc-4573-8423-4b56646f6f0d tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:10:36.024798 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-211e7d5a-f3fc-4573-8423-4b56646f6f0d tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:10:36.030726 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-211e7d5a-f3fc-4573-8423-4b56646f6f0d tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:36.031164 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-211e7d5a-f3fc-4573-8423-4b56646f6f0d tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:36.031934 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-211e7d5a-f3fc-4573-8423-4b56646f6f0d tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:36.032362 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-211e7d5a-f3fc-4573-8423-4b56646f6f0d tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:36.160450 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-211e7d5a-f3fc-4573-8423-4b56646f6f0d tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:10:36.167890 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-211e7d5a-f3fc-4573-8423-4b56646f6f0d tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25" status: 200 len: 1671 microversion: 2.1 time: 0.148071 Jul 05 13:10:36.168444 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 523/1051] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:10:36 2022] GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 => generated 1671 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:10:37.185508 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-da58dbb1-b487-4a50-9a3d-db48b26029c5 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:10:37.186207 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-da58dbb1-b487-4a50-9a3d-db48b26029c5 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:10:37.192791 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-da58dbb1-b487-4a50-9a3d-db48b26029c5 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:37.193236 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-da58dbb1-b487-4a50-9a3d-db48b26029c5 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:37.193989 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-da58dbb1-b487-4a50-9a3d-db48b26029c5 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:37.194946 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-da58dbb1-b487-4a50-9a3d-db48b26029c5 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:37.321748 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-da58dbb1-b487-4a50-9a3d-db48b26029c5 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:10:37.329481 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-da58dbb1-b487-4a50-9a3d-db48b26029c5 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25" status: 200 len: 1671 microversion: 2.1 time: 0.148140 Jul 05 13:10:37.330045 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 529/1052] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:10:37 2022] GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 => generated 1671 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:10:38.345721 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-da2c3129-ba74-4471-85a6-7c7f8a469d10 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:10:38.346332 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-da2c3129-ba74-4471-85a6-7c7f8a469d10 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:10:38.352935 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-da2c3129-ba74-4471-85a6-7c7f8a469d10 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:38.353381 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-da2c3129-ba74-4471-85a6-7c7f8a469d10 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:38.354138 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-da2c3129-ba74-4471-85a6-7c7f8a469d10 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:38.354570 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-da2c3129-ba74-4471-85a6-7c7f8a469d10 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:38.480508 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-da2c3129-ba74-4471-85a6-7c7f8a469d10 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:10:38.488305 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-da2c3129-ba74-4471-85a6-7c7f8a469d10 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25" status: 200 len: 1671 microversion: 2.1 time: 0.146394 Jul 05 13:10:38.488912 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 524/1053] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:10:38 2022] GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 => generated 1671 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:10:39.505333 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-8ed275e1-c9bb-48f8-87e5-78d96a10735f tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:10:39.505947 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-8ed275e1-c9bb-48f8-87e5-78d96a10735f tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:10:39.512533 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8ed275e1-c9bb-48f8-87e5-78d96a10735f tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:39.513007 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8ed275e1-c9bb-48f8-87e5-78d96a10735f tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:39.513767 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8ed275e1-c9bb-48f8-87e5-78d96a10735f tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:39.514197 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8ed275e1-c9bb-48f8-87e5-78d96a10735f tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:39.646158 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-8ed275e1-c9bb-48f8-87e5-78d96a10735f tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:10:39.654587 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-8ed275e1-c9bb-48f8-87e5-78d96a10735f tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25" status: 200 len: 1671 microversion: 2.1 time: 0.153016 Jul 05 13:10:39.655181 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 530/1054] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:10:39 2022] GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 => generated 1671 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:10:40.671880 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-3f53f9b1-77b8-45f7-8b9f-03d7a8bb26bd tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:10:40.672487 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-3f53f9b1-77b8-45f7-8b9f-03d7a8bb26bd tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:10:40.678628 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-3f53f9b1-77b8-45f7-8b9f-03d7a8bb26bd tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:40.679077 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-3f53f9b1-77b8-45f7-8b9f-03d7a8bb26bd tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:40.681810 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-3f53f9b1-77b8-45f7-8b9f-03d7a8bb26bd tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:40.681810 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-3f53f9b1-77b8-45f7-8b9f-03d7a8bb26bd tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:40.810661 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-3f53f9b1-77b8-45f7-8b9f-03d7a8bb26bd tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:10:40.818403 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-3f53f9b1-77b8-45f7-8b9f-03d7a8bb26bd tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25" status: 200 len: 1671 microversion: 2.1 time: 0.150527 Jul 05 13:10:40.818970 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 525/1055] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:10:40 2022] GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 => generated 1671 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:10:41.618535 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-b062510c-d7b6-44cf-a88f-8edefedecb60 req-5577b3f7-bed7-4008-be00-8a05d4c59341 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b55ca313-2e09-4b58-b7e7-cdda74ffdd25", "name": "network-vif-deleted", "tag": "10c331f6-aa21-4291-bc1b-87fa3f5495ba"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:10:41.627550 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-b062510c-d7b6-44cf-a88f-8edefedecb60 req-5577b3f7-bed7-4008-be00-8a05d4c59341 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:41.635296 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-b062510c-d7b6-44cf-a88f-8edefedecb60 req-5577b3f7-bed7-4008-be00-8a05d4c59341 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:41.639919 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-b062510c-d7b6-44cf-a88f-8edefedecb60 req-5577b3f7-bed7-4008-be00-8a05d4c59341 service nova] Creating event network-vif-deleted:10c331f6-aa21-4291-bc1b-87fa3f5495ba for instance b55ca313-2e09-4b58-b7e7-cdda74ffdd25 on hv-cinder-79760 Jul 05 13:10:41.645054 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-b062510c-d7b6-44cf-a88f-8edefedecb60 req-5577b3f7-bed7-4008-be00-8a05d4c59341 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030294 Jul 05 13:10:41.645638 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 531/1056] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:10:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:10:41.835553 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-52442e8f-fefa-4618-8283-7f985a519c54 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:10:41.837573 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-52442e8f-fefa-4618-8283-7f985a519c54 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:10:41.844286 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-52442e8f-fefa-4618-8283-7f985a519c54 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:41.844791 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-52442e8f-fefa-4618-8283-7f985a519c54 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:41.845559 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-52442e8f-fefa-4618-8283-7f985a519c54 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:41.846029 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-52442e8f-fefa-4618-8283-7f985a519c54 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:41.930089 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-52442e8f-fefa-4618-8283-7f985a519c54 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:10:41.939871 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-52442e8f-fefa-4618-8283-7f985a519c54 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25" status: 200 len: 1321 microversion: 2.1 time: 0.108170 Jul 05 13:10:41.950168 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 526/1057] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:10:41 2022] GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 => generated 1321 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:10:42.958154 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-d836166f-501e-4d6b-bd7d-5e49f9206b05 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:10:42.958858 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-d836166f-501e-4d6b-bd7d-5e49f9206b05 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:10:42.966544 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d836166f-501e-4d6b-bd7d-5e49f9206b05 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:42.967236 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d836166f-501e-4d6b-bd7d-5e49f9206b05 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:42.967738 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d836166f-501e-4d6b-bd7d-5e49f9206b05 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:42.968168 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d836166f-501e-4d6b-bd7d-5e49f9206b05 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:42.981737 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.wsgi [None req-d836166f-501e-4d6b-bd7d-5e49f9206b05 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] HTTP exception thrown: Instance b55ca313-2e09-4b58-b7e7-cdda74ffdd25 could not be found. Jul 05 13:10:42.983351 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-d836166f-501e-4d6b-bd7d-5e49f9206b05 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Request method failure captured: Jul 05 13:10:42.983351 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: request: GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 HTTP/1.1 Jul 05 13:10:42.983351 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept: application/json Jul 05 13:10:42.983351 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept-Encoding: identity Jul 05 13:10:42.983351 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Connection: close Jul 05 13:10:42.983351 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Length: 0 Jul 05 13:10:42.983351 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Type: application/json Jul 05 13:10:42.983351 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Host: 10.222.0.36 Jul 05 13:10:42.983351 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Openstack-System-Scope: None Jul 05 13:10:42.983351 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: User-Agent: python-urllib3/1.26.9 Jul 05 13:10:42.983351 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Auth-Token: gAAAAABixDd1eMnIl92b8_XGVczMchFuYVHQG_nrQ4hRQYU85ROtXKC6Dj8_un1UBiICko2roRRfLzLCRXveyKdGJJuBasj7tIj06-JO2_Sox3e8sjV--z7ur9pmCZXisSQSHO0VgqYAAKUg2lmCgW4T4-xF4YQzceHZP8rmU_ITZqDjzTPDUKM Jul 05 13:10:42.983351 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Id: None Jul 05 13:10:42.983351 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Name: None Jul 05 13:10:42.983351 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Identity-Status: Confirmed Jul 05 13:10:42.983351 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Is-Admin-Project: True Jul 05 13:10:42.983351 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Id: default Jul 05 13:10:42.983351 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Name: Default Jul 05 13:10:42.983351 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Id: a9e9afdc843646768800da2ede466298 Jul 05 13:10:42.983351 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Name: tempest-AttachVolumeTestJSON-475672718 Jul 05 13:10:42.983351 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Role: member,reader Jul 05 13:10:42.983351 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Roles: member,reader Jul 05 13:10:42.984986 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a9e9afdc843646768800da2ede466298"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a9e9afdc843646768800da2ede466298", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a9e9afdc843646768800da2ede466298"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a9e9afdc843646768800da2ede466298"}]}] Jul 05 13:10:42.984986 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant: tempest-AttachVolumeTestJSON-475672718 Jul 05 13:10:42.984986 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Id: a9e9afdc843646768800da2ede466298 Jul 05 13:10:42.984986 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Name: tempest-AttachVolumeTestJSON-475672718 Jul 05 13:10:42.984986 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User: tempest-AttachVolumeTestJSON-475672718-project Jul 05 13:10:42.984986 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Id: default Jul 05 13:10:42.984986 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Name: Default Jul 05 13:10:42.984986 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Id: 15ce49dfe7d0401caa1784c35b2ef90e Jul 05 13:10:42.984986 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Name: tempest-AttachVolumeTestJSON-475672718-project Jul 05 13:10:42.984986 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: method: > Jul 05 13:10:42.984986 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: exception: Instance b55ca313-2e09-4b58-b7e7-cdda74ffdd25 could not be found. Jul 05 13:10:42.984986 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: action_args: {'id': 'b55ca313-2e09-4b58-b7e7-cdda74ffdd25'} Jul 05 13:10:42.985993 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 13:10:42.985993 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:10:42.985993 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 13:10:42.985993 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 13:10:42.985993 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 13:10:42.985993 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 13:10:42.985993 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 13:10:42.985993 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 13:10:42.985993 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 13:10:42.985993 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 13:10:42.985993 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b55ca313-2e09-4b58-b7e7-cdda74ffdd25 could not be found. Jul 05 13:10:42.985993 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:10:42.985993 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:10:42.985993 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:10:42.985993 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:10:42.985993 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:10:42.985993 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:10:42.985993 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 13:10:42.985993 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 13:10:42.985993 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 13:10:42.988505 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 13:10:42.988505 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 13:10:42.988505 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 13:10:42.988505 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 13:10:42.988505 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 13:10:42.988505 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 13:10:42.988505 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 13:10:42.988505 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b55ca313-2e09-4b58-b7e7-cdda74ffdd25 could not be found. Jul 05 13:10:42.988505 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:10:42.988505 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:10:42.988505 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:10:42.988505 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:10:42.988505 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:10:42.988505 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:10:42.988505 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 13:10:42.988505 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 13:10:42.988505 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b55ca313-2e09-4b58-b7e7-cdda74ffdd25 could not be found. Jul 05 13:10:42.988505 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:10:42.990000 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-d836166f-501e-4d6b-bd7d-5e49f9206b05 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Returning 404 to user: Instance b55ca313-2e09-4b58-b7e7-cdda74ffdd25 could not be found. {{(pid=118387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 13:10:42.990000 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-d836166f-501e-4d6b-bd7d-5e49f9206b05 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25" status: 404 len: 111 microversion: 2.1 time: 0.030791 Jul 05 13:10:42.990000 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 532/1058] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:10:42 2022] GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 05 13:10:42.994075 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-c8947b81-b324-4b22-8fa0-be3711e1f035 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '.version_select at 0x7f70de527dc0>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:10:43.099658 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-c8947b81-b324-4b22-8fa0-be3711e1f035 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-110555287" status: 202 len: 0 microversion: 2.1 time: 0.109495 Jul 05 13:10:43.100156 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 527/1059] 10.222.0.36 () {58 vars in 1217 bytes} [Tue Jul 5 13:10:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-110555287 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 13:10:44.099242 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-f48f161b-0662-4dca-836f-62728f492748 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Action: 'create', calling method: .version_select at 0x7f70de6eb310>, body: {"keypair": {"name": "tempest-keypair-1471489962", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI2Nn0q6RJqJ7FT8D8CAFzF6Moto4FEBE4B8hMm0BJVRyGve1ypLBTjddAgUnnHbhGDj8xBECrijXasWxsWhBNO0Wvs1WjNqZVjlJJfUmSrlHcFaR01BYYH4xcgpR/7hYQ=="}} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:10:44.115393 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.quota [None req-f48f161b-0662-4dca-836f-62728f492748 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Getting quotas for project a9e9afdc843646768800da2ede466298. Resources: {'key_pairs'} {{(pid=118387) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 13:10:44.119528 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.quota [None req-f48f161b-0662-4dca-836f-62728f492748 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Getting quotas for user 15ce49dfe7d0401caa1784c35b2ef90e and project a9e9afdc843646768800da2ede466298. Resources: {'key_pairs'} {{(pid=118387) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 13:10:44.202326 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-f48f161b-0662-4dca-836f-62728f492748 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.106838 Jul 05 13:10:44.202918 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 533/1060] 10.222.0.36 () {60 vars in 1158 bytes} [Tue Jul 5 13:10:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:10:46.620535 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-277e0157-ad17-4531-b83f-97d114e7a0af tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1934154196", "imageRef": "d6134305-a5c0-4d2c-afc8-e54be21f685c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bec97ac2-609f-4a75-a848-802e6f109c92"}], "security_groups": [{"name": "tempest-securitygroup--23202734"}], "key_name": "tempest-keypair-1471489962", "user_data": "}} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:10:46.719682 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.network.neutron [None req-277e0157-ad17-4531-b83f-97d114e7a0af tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] validate_networks() for [('bec97ac2-609f-4a75-a848-802e6f109c92', None, None, None, None, None)] {{(pid=118386) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 13:10:47.320233 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.virt.hardware [None req-277e0157-ad17-4531-b83f-97d114e7a0af tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Flavor limits 0:0:0 {{(pid=118386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 13:10:47.320689 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.virt.hardware [None req-277e0157-ad17-4531-b83f-97d114e7a0af tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Image limits 0:0:0 {{(pid=118386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 13:10:47.321654 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.virt.hardware [None req-277e0157-ad17-4531-b83f-97d114e7a0af tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Flavor pref 0:0:0 {{(pid=118386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 13:10:47.322062 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.virt.hardware [None req-277e0157-ad17-4531-b83f-97d114e7a0af tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Image pref 0:0:0 {{(pid=118386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 13:10:47.322469 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.virt.hardware [None req-277e0157-ad17-4531-b83f-97d114e7a0af tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 13:10:47.331195 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-277e0157-ad17-4531-b83f-97d114e7a0af tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:47.331635 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-277e0157-ad17-4531-b83f-97d114e7a0af tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:47.332423 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-277e0157-ad17-4531-b83f-97d114e7a0af tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:47.332882 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-277e0157-ad17-4531-b83f-97d114e7a0af tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:47.349544 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.quota [None req-277e0157-ad17-4531-b83f-97d114e7a0af tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Getting quotas for project a9e9afdc843646768800da2ede466298. Resources: {'instances', 'cores', 'ram'} {{(pid=118386) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 13:10:47.353469 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.quota [None req-277e0157-ad17-4531-b83f-97d114e7a0af tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Getting quotas for user 15ce49dfe7d0401caa1784c35b2ef90e and project a9e9afdc843646768800da2ede466298. Resources: {'instances', 'cores', 'ram'} {{(pid=118386) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 13:10:47.364839 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-277e0157-ad17-4531-b83f-97d114e7a0af tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Going to run 1 instances... {{(pid=118386) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 13:10:47.367049 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-277e0157-ad17-4531-b83f-97d114e7a0af tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b41a4b2b-9dc1-4a39-add0-62f256d162d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d6134305-a5c0-4d2c-afc8-e54be21f685c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118386) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 13:10:47.526894 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR oslo.messaging._drivers.impl_rabbit [None req-277e0157-ad17-4531-b83f-97d114e7a0af tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [f9410387-bb7a-4672-bb1f-b88e722752f9] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 05 13:10:48.533693 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO oslo.messaging._drivers.impl_rabbit [None req-277e0157-ad17-4531-b83f-97d114e7a0af tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [f9410387-bb7a-4672-bb1f-b88e722752f9] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 42346. Jul 05 13:10:48.537920 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-277e0157-ad17-4531-b83f-97d114e7a0af tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.922772 Jul 05 13:10:48.538557 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 528/1061] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jul 5 13:10:46 2022] POST /compute/v2.1/servers => generated 400 bytes in 1924 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 05 13:10:48.549611 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-6f3b068d-b773-405b-bdde-09fda3e98eb2 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:10:48.550226 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-6f3b068d-b773-405b-bdde-09fda3e98eb2 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b41a4b2b-9dc1-4a39-add0-62f256d162d2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:10:48.604655 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-6f3b068d-b773-405b-bdde-09fda3e98eb2 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:10:48.611684 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-6f3b068d-b773-405b-bdde-09fda3e98eb2 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b41a4b2b-9dc1-4a39-add0-62f256d162d2" status: 200 len: 1238 microversion: 2.1 time: 0.066322 Jul 05 13:10:48.612250 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 534/1062] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:10:48 2022] GET /compute/v2.1/servers/b41a4b2b-9dc1-4a39-add0-62f256d162d2 => generated 1238 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:10:49.628536 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-e651e1f1-3709-42b7-9471-e849aec20b6a tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:10:49.629279 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-e651e1f1-3709-42b7-9471-e849aec20b6a tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b41a4b2b-9dc1-4a39-add0-62f256d162d2] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:10:49.635424 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e651e1f1-3709-42b7-9471-e849aec20b6a tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:49.635865 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e651e1f1-3709-42b7-9471-e849aec20b6a tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:49.636637 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e651e1f1-3709-42b7-9471-e849aec20b6a tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:49.637068 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e651e1f1-3709-42b7-9471-e849aec20b6a tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:49.701851 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-e651e1f1-3709-42b7-9471-e849aec20b6a tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:10:49.709441 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-e651e1f1-3709-42b7-9471-e849aec20b6a tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b41a4b2b-9dc1-4a39-add0-62f256d162d2" status: 200 len: 1242 microversion: 2.1 time: 0.085157 Jul 05 13:10:49.710001 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 529/1063] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:10:49 2022] GET /compute/v2.1/servers/b41a4b2b-9dc1-4a39-add0-62f256d162d2 => generated 1242 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:10:50.726315 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-132afa8e-a0c9-4da9-b9d7-d36a44904da6 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:10:50.726959 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-132afa8e-a0c9-4da9-b9d7-d36a44904da6 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b41a4b2b-9dc1-4a39-add0-62f256d162d2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:10:50.734078 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-132afa8e-a0c9-4da9-b9d7-d36a44904da6 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:50.734521 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-132afa8e-a0c9-4da9-b9d7-d36a44904da6 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:50.735370 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-132afa8e-a0c9-4da9-b9d7-d36a44904da6 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:50.736209 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-132afa8e-a0c9-4da9-b9d7-d36a44904da6 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:50.800739 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-132afa8e-a0c9-4da9-b9d7-d36a44904da6 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:10:50.808848 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-132afa8e-a0c9-4da9-b9d7-d36a44904da6 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b41a4b2b-9dc1-4a39-add0-62f256d162d2" status: 200 len: 1298 microversion: 2.1 time: 0.086272 Jul 05 13:10:50.809449 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 535/1064] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:10:50 2022] GET /compute/v2.1/servers/b41a4b2b-9dc1-4a39-add0-62f256d162d2 => generated 1298 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:10:51.826553 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-8cf5ab4f-0861-4195-a81c-b80dfc0d64eb tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:10:51.827160 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-8cf5ab4f-0861-4195-a81c-b80dfc0d64eb tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b41a4b2b-9dc1-4a39-add0-62f256d162d2] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:10:51.833806 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-8cf5ab4f-0861-4195-a81c-b80dfc0d64eb tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:51.834249 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-8cf5ab4f-0861-4195-a81c-b80dfc0d64eb tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:51.835042 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-8cf5ab4f-0861-4195-a81c-b80dfc0d64eb tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:51.835472 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-8cf5ab4f-0861-4195-a81c-b80dfc0d64eb tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:51.972170 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-8cf5ab4f-0861-4195-a81c-b80dfc0d64eb tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:10:51.981045 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-8cf5ab4f-0861-4195-a81c-b80dfc0d64eb tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b41a4b2b-9dc1-4a39-add0-62f256d162d2" status: 200 len: 1362 microversion: 2.1 time: 0.158186 Jul 05 13:10:51.988275 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 530/1065] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:10:51 2022] GET /compute/v2.1/servers/b41a4b2b-9dc1-4a39-add0-62f256d162d2 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:10:52.300306 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-5aa168b3-8a9a-48ba-b137-00ac1af5beba req-ad414d4c-79fb-4bf4-a7aa-f4487fb58451 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b41a4b2b-9dc1-4a39-add0-62f256d162d2", "tag": "7b5e2639-847f-4500-9b16-4a340a956382"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:10:52.309884 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-5aa168b3-8a9a-48ba-b137-00ac1af5beba req-ad414d4c-79fb-4bf4-a7aa-f4487fb58451 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:52.310385 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-5aa168b3-8a9a-48ba-b137-00ac1af5beba req-ad414d4c-79fb-4bf4-a7aa-f4487fb58451 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:52.322149 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-5aa168b3-8a9a-48ba-b137-00ac1af5beba req-ad414d4c-79fb-4bf4-a7aa-f4487fb58451 service nova] Creating event network-changed:7b5e2639-847f-4500-9b16-4a340a956382 for instance b41a4b2b-9dc1-4a39-add0-62f256d162d2 on hv-cinder-79760 Jul 05 13:10:52.327666 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-5aa168b3-8a9a-48ba-b137-00ac1af5beba req-ad414d4c-79fb-4bf4-a7aa-f4487fb58451 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031394 Jul 05 13:10:52.328883 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 536/1066] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:10:52.999374 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-7b186eb6-be35-4b40-8676-4a181b6f0a8d tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:10:52.999988 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-7b186eb6-be35-4b40-8676-4a181b6f0a8d tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b41a4b2b-9dc1-4a39-add0-62f256d162d2] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:10:53.006385 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-7b186eb6-be35-4b40-8676-4a181b6f0a8d tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:53.007330 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-7b186eb6-be35-4b40-8676-4a181b6f0a8d tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:53.007721 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-7b186eb6-be35-4b40-8676-4a181b6f0a8d tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:53.008211 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-7b186eb6-be35-4b40-8676-4a181b6f0a8d tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:53.286559 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-7b186eb6-be35-4b40-8676-4a181b6f0a8d tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:10:53.294575 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-7b186eb6-be35-4b40-8676-4a181b6f0a8d tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b41a4b2b-9dc1-4a39-add0-62f256d162d2" status: 200 len: 1362 microversion: 2.1 time: 0.299097 Jul 05 13:10:53.295164 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 531/1067] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:10:52 2022] GET /compute/v2.1/servers/b41a4b2b-9dc1-4a39-add0-62f256d162d2 => generated 1362 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:10:54.312191 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-6bcf4cca-6417-45dc-87fd-483a0acf4a3e tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:10:54.312978 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-6bcf4cca-6417-45dc-87fd-483a0acf4a3e tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b41a4b2b-9dc1-4a39-add0-62f256d162d2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:10:54.319196 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6bcf4cca-6417-45dc-87fd-483a0acf4a3e tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:54.319590 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6bcf4cca-6417-45dc-87fd-483a0acf4a3e tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:54.320354 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6bcf4cca-6417-45dc-87fd-483a0acf4a3e tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:54.320820 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6bcf4cca-6417-45dc-87fd-483a0acf4a3e tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:54.451365 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-6bcf4cca-6417-45dc-87fd-483a0acf4a3e tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:10:54.458826 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-6bcf4cca-6417-45dc-87fd-483a0acf4a3e tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b41a4b2b-9dc1-4a39-add0-62f256d162d2" status: 200 len: 1362 microversion: 2.1 time: 0.151237 Jul 05 13:10:54.459428 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 537/1068] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:10:54 2022] GET /compute/v2.1/servers/b41a4b2b-9dc1-4a39-add0-62f256d162d2 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:10:55.475902 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-62723ca1-2778-49f0-b962-ab857fc4a569 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:10:55.476524 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-62723ca1-2778-49f0-b962-ab857fc4a569 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b41a4b2b-9dc1-4a39-add0-62f256d162d2] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:10:55.483729 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-62723ca1-2778-49f0-b962-ab857fc4a569 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:55.484173 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-62723ca1-2778-49f0-b962-ab857fc4a569 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:55.484955 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-62723ca1-2778-49f0-b962-ab857fc4a569 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:55.485401 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-62723ca1-2778-49f0-b962-ab857fc4a569 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:55.610938 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-62723ca1-2778-49f0-b962-ab857fc4a569 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:10:55.618936 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-62723ca1-2778-49f0-b962-ab857fc4a569 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b41a4b2b-9dc1-4a39-add0-62f256d162d2" status: 200 len: 1362 microversion: 2.1 time: 0.146688 Jul 05 13:10:55.619488 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 532/1069] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:10:55 2022] GET /compute/v2.1/servers/b41a4b2b-9dc1-4a39-add0-62f256d162d2 => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:10:56.644334 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-106b38c1-0e47-4494-ac22-b1923215a1ae tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:10:56.644985 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-106b38c1-0e47-4494-ac22-b1923215a1ae tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b41a4b2b-9dc1-4a39-add0-62f256d162d2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:10:56.652066 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-106b38c1-0e47-4494-ac22-b1923215a1ae tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:56.652520 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-106b38c1-0e47-4494-ac22-b1923215a1ae tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:56.653314 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-106b38c1-0e47-4494-ac22-b1923215a1ae tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:56.653756 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-106b38c1-0e47-4494-ac22-b1923215a1ae tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:56.790738 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-106b38c1-0e47-4494-ac22-b1923215a1ae tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:10:56.798867 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-106b38c1-0e47-4494-ac22-b1923215a1ae tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b41a4b2b-9dc1-4a39-add0-62f256d162d2" status: 200 len: 1362 microversion: 2.1 time: 0.158338 Jul 05 13:10:56.799520 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 538/1070] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:10:56 2022] GET /compute/v2.1/servers/b41a4b2b-9dc1-4a39-add0-62f256d162d2 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:10:57.815301 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-53117498-fb9c-42b3-aeed-99ef960cb175 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:10:57.815917 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-53117498-fb9c-42b3-aeed-99ef960cb175 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b41a4b2b-9dc1-4a39-add0-62f256d162d2] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:10:57.818439 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_cell0:SELECT=2 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:10:57.819117 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_cell0:SELECT=6 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:10:57.819743 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:10:57.824466 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-53117498-fb9c-42b3-aeed-99ef960cb175 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:57.824949 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-53117498-fb9c-42b3-aeed-99ef960cb175 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:57.825715 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-53117498-fb9c-42b3-aeed-99ef960cb175 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:57.826150 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-53117498-fb9c-42b3-aeed-99ef960cb175 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:57.828758 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=1 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:10:57.871825 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-2a090023-69d5-475e-9453-d179eaa53ef8 req-89e1c1fc-3dbd-4894-b227-9b35c11dc31d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b41a4b2b-9dc1-4a39-add0-62f256d162d2", "name": "network-vif-plugged", "status": "completed", "tag": "7b5e2639-847f-4500-9b16-4a340a956382"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:10:57.880781 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-2a090023-69d5-475e-9453-d179eaa53ef8 req-89e1c1fc-3dbd-4894-b227-9b35c11dc31d service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:57.881221 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-2a090023-69d5-475e-9453-d179eaa53ef8 req-89e1c1fc-3dbd-4894-b227-9b35c11dc31d service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:57.892067 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-2a090023-69d5-475e-9453-d179eaa53ef8 req-89e1c1fc-3dbd-4894-b227-9b35c11dc31d service nova] Creating event network-vif-plugged:7b5e2639-847f-4500-9b16-4a340a956382 for instance b41a4b2b-9dc1-4a39-add0-62f256d162d2 on hv-cinder-79760 Jul 05 13:10:57.901409 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-2a090023-69d5-475e-9453-d179eaa53ef8 req-89e1c1fc-3dbd-4894-b227-9b35c11dc31d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029689 Jul 05 13:10:57.901409 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 539/1071] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:10:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 13:10:57.959723 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-53117498-fb9c-42b3-aeed-99ef960cb175 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:10:57.968158 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-53117498-fb9c-42b3-aeed-99ef960cb175 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b41a4b2b-9dc1-4a39-add0-62f256d162d2" status: 200 len: 1362 microversion: 2.1 time: 0.156832 Jul 05 13:10:57.970699 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 533/1072] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:10:57 2022] GET /compute/v2.1/servers/b41a4b2b-9dc1-4a39-add0-62f256d162d2 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:10:58.982786 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell0:SELECT=6 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:10:58.987364 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-da3fb2aa-b85d-4fa1-b20c-2f0557b4e4da tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:10:58.988071 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-da3fb2aa-b85d-4fa1-b20c-2f0557b4e4da tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b41a4b2b-9dc1-4a39-add0-62f256d162d2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:10:58.989907 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:10:58.994803 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-da3fb2aa-b85d-4fa1-b20c-2f0557b4e4da tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:58.995252 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-da3fb2aa-b85d-4fa1-b20c-2f0557b4e4da tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:58.996012 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-da3fb2aa-b85d-4fa1-b20c-2f0557b4e4da tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:10:58.996448 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-da3fb2aa-b85d-4fa1-b20c-2f0557b4e4da tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:10:58.999010 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell1:SELECT=78,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:10:59.131290 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-da3fb2aa-b85d-4fa1-b20c-2f0557b4e4da tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:10:59.138902 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-da3fb2aa-b85d-4fa1-b20c-2f0557b4e4da tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b41a4b2b-9dc1-4a39-add0-62f256d162d2" status: 200 len: 1362 microversion: 2.1 time: 0.157401 Jul 05 13:10:59.139462 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 540/1073] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:10:58 2022] GET /compute/v2.1/servers/b41a4b2b-9dc1-4a39-add0-62f256d162d2 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:11:00.155910 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-423fbcd0-a70c-4099-88d1-e45041175853 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:11:00.156671 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-423fbcd0-a70c-4099-88d1-e45041175853 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b41a4b2b-9dc1-4a39-add0-62f256d162d2] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:11:00.164054 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-423fbcd0-a70c-4099-88d1-e45041175853 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:00.164509 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-423fbcd0-a70c-4099-88d1-e45041175853 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:00.165304 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-423fbcd0-a70c-4099-88d1-e45041175853 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:00.166246 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-423fbcd0-a70c-4099-88d1-e45041175853 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:00.449548 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-423fbcd0-a70c-4099-88d1-e45041175853 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:11:00.456980 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-423fbcd0-a70c-4099-88d1-e45041175853 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b41a4b2b-9dc1-4a39-add0-62f256d162d2" status: 200 len: 1547 microversion: 2.1 time: 0.305663 Jul 05 13:11:00.457537 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 534/1074] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:11:00 2022] GET /compute/v2.1/servers/b41a4b2b-9dc1-4a39-add0-62f256d162d2 => generated 1547 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:11:00.473672 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-fc9dc9f2-6441-4239-bac7-62b0b0403eaa tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:11:00.474149 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-fc9dc9f2-6441-4239-bac7-62b0b0403eaa tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b41a4b2b-9dc1-4a39-add0-62f256d162d2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:11:00.482813 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-fc9dc9f2-6441-4239-bac7-62b0b0403eaa tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:00.483266 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-fc9dc9f2-6441-4239-bac7-62b0b0403eaa tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:00.484027 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-fc9dc9f2-6441-4239-bac7-62b0b0403eaa tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:00.484465 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-fc9dc9f2-6441-4239-bac7-62b0b0403eaa tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:00.563494 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-fc9dc9f2-6441-4239-bac7-62b0b0403eaa tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b41a4b2b-9dc1-4a39-add0-62f256d162d2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093641 Jul 05 13:11:00.564090 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 541/1075] 10.222.0.36 () {58 vars in 1274 bytes} [Tue Jul 5 13:11:00 2022] GET /compute/v2.1/servers/b41a4b2b-9dc1-4a39-add0-62f256d162d2/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:11:01.584839 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [req-e88bfecc-45b5-496f-9eac-49f5b02140c7 req-65cfa69d-f22d-48c5-b4c2-2206c64aa1f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b41a4b2b-9dc1-4a39-add0-62f256d162d2", "tag": "7b5e2639-847f-4500-9b16-4a340a956382"}]} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:11:01.594179 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-e88bfecc-45b5-496f-9eac-49f5b02140c7 req-65cfa69d-f22d-48c5-b4c2-2206c64aa1f6 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:01.594752 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-e88bfecc-45b5-496f-9eac-49f5b02140c7 req-65cfa69d-f22d-48c5-b4c2-2206c64aa1f6 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:01.608196 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.compute.server_external_events [req-e88bfecc-45b5-496f-9eac-49f5b02140c7 req-65cfa69d-f22d-48c5-b4c2-2206c64aa1f6 service nova] Creating event network-changed:7b5e2639-847f-4500-9b16-4a340a956382 for instance b41a4b2b-9dc1-4a39-add0-62f256d162d2 on hv-cinder-79760 Jul 05 13:11:01.613567 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [req-e88bfecc-45b5-496f-9eac-49f5b02140c7 req-65cfa69d-f22d-48c5-b4c2-2206c64aa1f6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032455 Jul 05 13:11:01.619272 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 535/1076] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:11:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:11:24.554701 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-b7363786-bb7f-4af1-955d-79af3791228a tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Action: 'create', calling method: .version_select at 0x7f70de9d73a0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-968582176", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJHD7MxoCvK9gtH57UXvLrfdBqNc7XLjchPFClYVxRGHVehObE7CYV0eD7jEBGRjOsdiq3VxglvRpJC0WnBX4pdrAcqYJzZQNyNNgUge2xGR8Te+Gm7npD5FigRkcolmVA=="}} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:11:24.569575 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.quota [None req-b7363786-bb7f-4af1-955d-79af3791228a tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Getting quotas for project 4e0f29cb8f344bbf9fd1b7ffb626bbcb. Resources: {'key_pairs'} {{(pid=118387) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 13:11:24.573916 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.quota [None req-b7363786-bb7f-4af1-955d-79af3791228a tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Getting quotas for user dc8472b840794ab8ac0ccd49b2fd1657 and project 4e0f29cb8f344bbf9fd1b7ffb626bbcb. Resources: {'key_pairs'} {{(pid=118387) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 13:11:24.689508 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-b7363786-bb7f-4af1-955d-79af3791228a tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.139969 Jul 05 13:11:24.694568 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 542/1077] 10.222.0.36 () {60 vars in 1158 bytes} [Tue Jul 5 13:11:24 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:11:24.735674 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_api:SELECT=5 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:11:24.736422 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_cell1:SELECT=13 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:11:24.740452 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-b3471f73-7971-4de8-a0b1-c582fcd848b7 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2064504330", "imageRef": "c7456f5b-a5b7-4f75-ad89-d61043ec93d1", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-968582176", "networks": [{"uuid": "6703ce4c-07e8-4a7e-8216-b7caf6655850"}]}} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:11:24.790574 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.network.neutron [None req-b3471f73-7971-4de8-a0b1-c582fcd848b7 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] validate_networks() for [('6703ce4c-07e8-4a7e-8216-b7caf6655850', None, None, None, None, None)] {{(pid=118386) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 13:11:25.253844 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.virt.hardware [None req-b3471f73-7971-4de8-a0b1-c582fcd848b7 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Flavor limits 0:0:0 {{(pid=118386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 13:11:25.254391 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.virt.hardware [None req-b3471f73-7971-4de8-a0b1-c582fcd848b7 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Image limits 0:0:0 {{(pid=118386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 13:11:25.254789 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.virt.hardware [None req-b3471f73-7971-4de8-a0b1-c582fcd848b7 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Flavor pref 0:0:0 {{(pid=118386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 13:11:25.255194 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.virt.hardware [None req-b3471f73-7971-4de8-a0b1-c582fcd848b7 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Image pref 0:0:0 {{(pid=118386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 13:11:25.255599 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.virt.hardware [None req-b3471f73-7971-4de8-a0b1-c582fcd848b7 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 13:11:25.264539 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b3471f73-7971-4de8-a0b1-c582fcd848b7 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:25.265012 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b3471f73-7971-4de8-a0b1-c582fcd848b7 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:25.265805 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b3471f73-7971-4de8-a0b1-c582fcd848b7 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:25.266235 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-b3471f73-7971-4de8-a0b1-c582fcd848b7 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:25.282912 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.quota [None req-b3471f73-7971-4de8-a0b1-c582fcd848b7 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Getting quotas for project 4e0f29cb8f344bbf9fd1b7ffb626bbcb. Resources: {'instances', 'cores', 'ram'} {{(pid=118386) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 13:11:25.286777 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.quota [None req-b3471f73-7971-4de8-a0b1-c582fcd848b7 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Getting quotas for user dc8472b840794ab8ac0ccd49b2fd1657 and project 4e0f29cb8f344bbf9fd1b7ffb626bbcb. Resources: {'instances', 'cores', 'ram'} {{(pid=118386) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 13:11:25.298583 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-b3471f73-7971-4de8-a0b1-c582fcd848b7 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Going to run 1 instances... {{(pid=118386) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 13:11:25.300890 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-b3471f73-7971-4de8-a0b1-c582fcd848b7 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] [instance: b83da4e1-8af3-4959-905a-6f3be7e2cf19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c7456f5b-a5b7-4f75-ad89-d61043ec93d1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118386) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 13:11:25.472817 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-b3471f73-7971-4de8-a0b1-c582fcd848b7 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.738452 Jul 05 13:11:25.473448 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 536/1078] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jul 5 13:11:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 05 13:11:25.483392 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-e41ca08f-93fc-47bc-8a80-9c22247dd3d2 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:11:25.484053 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-e41ca08f-93fc-47bc-8a80-9c22247dd3d2 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] [instance: b83da4e1-8af3-4959-905a-6f3be7e2cf19] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:11:25.652711 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-e41ca08f-93fc-47bc-8a80-9c22247dd3d2 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8472b840794ab8ac0ccd49b2fd1657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0f29cb8f344bbf9fd1b7ffb626bbcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:11:25.692633 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-e41ca08f-93fc-47bc-8a80-9c22247dd3d2 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] 10.222.0.36 "GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19" status: 200 len: 1258 microversion: 2.1 time: 0.181647 Jul 05 13:11:25.692633 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 543/1079] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:11:25 2022] GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19 => generated 1258 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:11:26.677945 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-3579c651-7c7a-4d70-b1e9-416d2114cfc7 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:11:26.678571 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-3579c651-7c7a-4d70-b1e9-416d2114cfc7 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] [instance: b83da4e1-8af3-4959-905a-6f3be7e2cf19] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:11:26.732942 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-3579c651-7c7a-4d70-b1e9-416d2114cfc7 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8472b840794ab8ac0ccd49b2fd1657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0f29cb8f344bbf9fd1b7ffb626bbcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:11:26.739574 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-3579c651-7c7a-4d70-b1e9-416d2114cfc7 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] 10.222.0.36 "GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19" status: 200 len: 1258 microversion: 2.1 time: 0.065547 Jul 05 13:11:26.740124 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 537/1080] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:11:26 2022] GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19 => generated 1258 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:11:27.756383 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-bdbd7f04-7da0-4684-b005-995a7624f7da tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:11:27.757021 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-bdbd7f04-7da0-4684-b005-995a7624f7da tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] [instance: b83da4e1-8af3-4959-905a-6f3be7e2cf19] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:11:27.764158 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-bdbd7f04-7da0-4684-b005-995a7624f7da tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:27.764629 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-bdbd7f04-7da0-4684-b005-995a7624f7da tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:27.765389 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-bdbd7f04-7da0-4684-b005-995a7624f7da tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:27.765822 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-bdbd7f04-7da0-4684-b005-995a7624f7da tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:27.828543 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-bdbd7f04-7da0-4684-b005-995a7624f7da tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8472b840794ab8ac0ccd49b2fd1657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0f29cb8f344bbf9fd1b7ffb626bbcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:11:27.836033 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-bdbd7f04-7da0-4684-b005-995a7624f7da tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] 10.222.0.36 "GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19" status: 200 len: 1310 microversion: 2.1 time: 0.083640 Jul 05 13:11:27.836603 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 544/1081] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:11:27 2022] GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19 => generated 1310 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:11:28.859489 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-d8897730-1fed-4b2b-8cee-a12abc3abeee tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:11:28.859489 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-d8897730-1fed-4b2b-8cee-a12abc3abeee tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] [instance: b83da4e1-8af3-4959-905a-6f3be7e2cf19] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:11:28.862211 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-d8897730-1fed-4b2b-8cee-a12abc3abeee tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:28.862665 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-d8897730-1fed-4b2b-8cee-a12abc3abeee tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:28.864161 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-d8897730-1fed-4b2b-8cee-a12abc3abeee tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:28.864161 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-d8897730-1fed-4b2b-8cee-a12abc3abeee tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:29.130535 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-d8897730-1fed-4b2b-8cee-a12abc3abeee tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8472b840794ab8ac0ccd49b2fd1657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0f29cb8f344bbf9fd1b7ffb626bbcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:11:29.143052 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-d8897730-1fed-4b2b-8cee-a12abc3abeee tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] 10.222.0.36 "GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19" status: 200 len: 1358 microversion: 2.1 time: 0.293151 Jul 05 13:11:29.155547 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 538/1082] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:11:28 2022] GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19 => generated 1358 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:11:30.163601 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-fc9ae59a-a575-4d92-a244-f782855cac47 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:11:30.164206 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-fc9ae59a-a575-4d92-a244-f782855cac47 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] [instance: b83da4e1-8af3-4959-905a-6f3be7e2cf19] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:11:30.171048 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-fc9ae59a-a575-4d92-a244-f782855cac47 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:30.171500 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-fc9ae59a-a575-4d92-a244-f782855cac47 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:30.172268 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-fc9ae59a-a575-4d92-a244-f782855cac47 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:30.172732 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-fc9ae59a-a575-4d92-a244-f782855cac47 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:30.315338 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-fc9ae59a-a575-4d92-a244-f782855cac47 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8472b840794ab8ac0ccd49b2fd1657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0f29cb8f344bbf9fd1b7ffb626bbcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:11:30.329167 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-fc9ae59a-a575-4d92-a244-f782855cac47 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] 10.222.0.36 "GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19" status: 200 len: 1358 microversion: 2.1 time: 0.169229 Jul 05 13:11:30.329667 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 545/1083] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:11:30 2022] GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:11:31.345953 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-5e4cd4ec-8c95-46ed-baad-3ca3db99c359 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:11:31.346702 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-5e4cd4ec-8c95-46ed-baad-3ca3db99c359 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] [instance: b83da4e1-8af3-4959-905a-6f3be7e2cf19] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:11:31.353514 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-5e4cd4ec-8c95-46ed-baad-3ca3db99c359 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:31.354126 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-5e4cd4ec-8c95-46ed-baad-3ca3db99c359 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:31.354900 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-5e4cd4ec-8c95-46ed-baad-3ca3db99c359 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:31.355330 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-5e4cd4ec-8c95-46ed-baad-3ca3db99c359 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:31.490391 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-5e4cd4ec-8c95-46ed-baad-3ca3db99c359 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8472b840794ab8ac0ccd49b2fd1657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0f29cb8f344bbf9fd1b7ffb626bbcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:11:31.498641 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-5e4cd4ec-8c95-46ed-baad-3ca3db99c359 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] 10.222.0.36 "GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19" status: 200 len: 1358 microversion: 2.1 time: 0.156597 Jul 05 13:11:31.499432 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 539/1084] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:11:31 2022] GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:11:32.515710 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-d74c3287-7751-4afe-9f7f-346aed710635 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:11:32.516550 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-d74c3287-7751-4afe-9f7f-346aed710635 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] [instance: b83da4e1-8af3-4959-905a-6f3be7e2cf19] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:11:32.524200 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d74c3287-7751-4afe-9f7f-346aed710635 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:32.524777 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d74c3287-7751-4afe-9f7f-346aed710635 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:32.525644 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d74c3287-7751-4afe-9f7f-346aed710635 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:32.526582 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d74c3287-7751-4afe-9f7f-346aed710635 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:32.670738 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-d74c3287-7751-4afe-9f7f-346aed710635 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8472b840794ab8ac0ccd49b2fd1657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0f29cb8f344bbf9fd1b7ffb626bbcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:11:32.682419 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-d74c3287-7751-4afe-9f7f-346aed710635 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] 10.222.0.36 "GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19" status: 200 len: 1358 microversion: 2.1 time: 0.169769 Jul 05 13:11:32.683019 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 546/1085] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:11:32 2022] GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:11:33.699929 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-cc83cf25-07b8-4c18-a16a-63f4588a0275 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:11:33.700528 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-cc83cf25-07b8-4c18-a16a-63f4588a0275 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] [instance: b83da4e1-8af3-4959-905a-6f3be7e2cf19] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:11:33.707964 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-cc83cf25-07b8-4c18-a16a-63f4588a0275 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:33.708419 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-cc83cf25-07b8-4c18-a16a-63f4588a0275 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:33.709328 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-cc83cf25-07b8-4c18-a16a-63f4588a0275 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:33.709764 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-cc83cf25-07b8-4c18-a16a-63f4588a0275 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:33.844177 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-cc83cf25-07b8-4c18-a16a-63f4588a0275 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8472b840794ab8ac0ccd49b2fd1657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0f29cb8f344bbf9fd1b7ffb626bbcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:11:33.851962 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-cc83cf25-07b8-4c18-a16a-63f4588a0275 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] 10.222.0.36 "GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19" status: 200 len: 1358 microversion: 2.1 time: 0.156440 Jul 05 13:11:33.852725 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 540/1086] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:11:33 2022] GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:11:34.869824 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-aab58d31-a6be-4bf4-9b2e-29dfb0cf235e tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:11:34.870566 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-aab58d31-a6be-4bf4-9b2e-29dfb0cf235e tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] [instance: b83da4e1-8af3-4959-905a-6f3be7e2cf19] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:11:34.877314 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-aab58d31-a6be-4bf4-9b2e-29dfb0cf235e tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:34.877853 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-aab58d31-a6be-4bf4-9b2e-29dfb0cf235e tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:34.878709 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-aab58d31-a6be-4bf4-9b2e-29dfb0cf235e tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:34.879238 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-aab58d31-a6be-4bf4-9b2e-29dfb0cf235e tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:35.029471 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-aab58d31-a6be-4bf4-9b2e-29dfb0cf235e tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8472b840794ab8ac0ccd49b2fd1657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0f29cb8f344bbf9fd1b7ffb626bbcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:11:35.037034 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-aab58d31-a6be-4bf4-9b2e-29dfb0cf235e tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] 10.222.0.36 "GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19" status: 200 len: 1358 microversion: 2.1 time: 0.171007 Jul 05 13:11:35.037611 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 547/1087] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:11:34 2022] GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:11:36.060537 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-ad6e11c0-1529-474b-bd7f-06305ce25697 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:11:36.062278 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-ad6e11c0-1529-474b-bd7f-06305ce25697 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] [instance: b83da4e1-8af3-4959-905a-6f3be7e2cf19] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:11:36.071664 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_cell0:SELECT=2 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:11:36.074201 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ad6e11c0-1529-474b-bd7f-06305ce25697 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:36.074715 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ad6e11c0-1529-474b-bd7f-06305ce25697 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:36.075575 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ad6e11c0-1529-474b-bd7f-06305ce25697 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:36.076136 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ad6e11c0-1529-474b-bd7f-06305ce25697 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:36.429421 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-ad6e11c0-1529-474b-bd7f-06305ce25697 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8472b840794ab8ac0ccd49b2fd1657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0f29cb8f344bbf9fd1b7ffb626bbcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:11:36.429421 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-ad6e11c0-1529-474b-bd7f-06305ce25697 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] 10.222.0.36 "GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19" status: 200 len: 1358 microversion: 2.1 time: 0.194207 Jul 05 13:11:36.429421 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 541/1088] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:11:36 2022] GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19 => generated 1358 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:11:37.443815 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-f9079f62-8416-49d1-b099-13c234260e73 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:11:37.444452 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-f9079f62-8416-49d1-b099-13c234260e73 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] [instance: b83da4e1-8af3-4959-905a-6f3be7e2cf19] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:11:37.446424 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell0:SELECT=6 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:11:37.451764 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f9079f62-8416-49d1-b099-13c234260e73 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:37.452209 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f9079f62-8416-49d1-b099-13c234260e73 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:37.453009 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f9079f62-8416-49d1-b099-13c234260e73 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:37.453592 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f9079f62-8416-49d1-b099-13c234260e73 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:37.481171 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_cell0:SELECT=8 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:11:37.558312 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [req-4970d383-9c81-4732-a4da-4235a1fba3f1 req-8e7422a6-f6a0-4f57-828a-06b426427156 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b83da4e1-8af3-4959-905a-6f3be7e2cf19", "tag": "6058ab7a-1269-4b24-bfb7-6b0f5686441f"}]} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:11:37.567087 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-4970d383-9c81-4732-a4da-4235a1fba3f1 req-8e7422a6-f6a0-4f57-828a-06b426427156 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:37.567528 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-4970d383-9c81-4732-a4da-4235a1fba3f1 req-8e7422a6-f6a0-4f57-828a-06b426427156 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:37.579675 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.compute.server_external_events [req-4970d383-9c81-4732-a4da-4235a1fba3f1 req-8e7422a6-f6a0-4f57-828a-06b426427156 service nova] Creating event network-changed:6058ab7a-1269-4b24-bfb7-6b0f5686441f for instance b83da4e1-8af3-4959-905a-6f3be7e2cf19 on hv-cinder-79760 Jul 05 13:11:37.585210 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [req-4970d383-9c81-4732-a4da-4235a1fba3f1 req-8e7422a6-f6a0-4f57-828a-06b426427156 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113888 Jul 05 13:11:37.586165 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 542/1089] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:11:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:11:37.607894 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-f9079f62-8416-49d1-b099-13c234260e73 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8472b840794ab8ac0ccd49b2fd1657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0f29cb8f344bbf9fd1b7ffb626bbcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:11:37.615977 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-f9079f62-8416-49d1-b099-13c234260e73 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] 10.222.0.36 "GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19" status: 200 len: 1358 microversion: 2.1 time: 0.175981 Jul 05 13:11:37.620943 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 548/1090] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:11:37 2022] GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:11:38.209977 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-7ae9894c-c026-4d30-80fe-964fff6d38a6 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:11:38.210567 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-7ae9894c-c026-4d30-80fe-964fff6d38a6 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b41a4b2b-9dc1-4a39-add0-62f256d162d2] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:11:38.218603 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-7ae9894c-c026-4d30-80fe-964fff6d38a6 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:38.219193 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-7ae9894c-c026-4d30-80fe-964fff6d38a6 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:38.219969 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-7ae9894c-c026-4d30-80fe-964fff6d38a6 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:38.220415 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-7ae9894c-c026-4d30-80fe-964fff6d38a6 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:38.243597 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-7ae9894c-c026-4d30-80fe-964fff6d38a6 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b41a4b2b-9dc1-4a39-add0-62f256d162d2/ips" status: 200 len: 145 microversion: 2.1 time: 0.038255 Jul 05 13:11:38.244172 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 543/1091] 10.222.0.36 () {58 vars in 1247 bytes} [Tue Jul 5 13:11:38 2022] GET /compute/v2.1/servers/b41a4b2b-9dc1-4a39-add0-62f256d162d2/ips => generated 145 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:11:38.632266 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-b99f73af-8e58-47f2-9c76-4d75c12bb052 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:11:38.633062 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-b99f73af-8e58-47f2-9c76-4d75c12bb052 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] [instance: b83da4e1-8af3-4959-905a-6f3be7e2cf19] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:11:38.643636 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b99f73af-8e58-47f2-9c76-4d75c12bb052 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:38.643636 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b99f73af-8e58-47f2-9c76-4d75c12bb052 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:38.643636 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b99f73af-8e58-47f2-9c76-4d75c12bb052 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:38.643636 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b99f73af-8e58-47f2-9c76-4d75c12bb052 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:38.780399 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-b99f73af-8e58-47f2-9c76-4d75c12bb052 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8472b840794ab8ac0ccd49b2fd1657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0f29cb8f344bbf9fd1b7ffb626bbcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:11:38.787982 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-b99f73af-8e58-47f2-9c76-4d75c12bb052 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] 10.222.0.36 "GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19" status: 200 len: 1358 microversion: 2.1 time: 0.159526 Jul 05 13:11:38.788575 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 549/1092] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:11:38 2022] GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:11:39.804603 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-5d5c219e-9c01-4f25-b834-fe0afeee8509 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:11:39.805226 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-5d5c219e-9c01-4f25-b834-fe0afeee8509 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] [instance: b83da4e1-8af3-4959-905a-6f3be7e2cf19] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:11:39.811722 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-5d5c219e-9c01-4f25-b834-fe0afeee8509 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:39.812176 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-5d5c219e-9c01-4f25-b834-fe0afeee8509 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:39.812972 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-5d5c219e-9c01-4f25-b834-fe0afeee8509 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:39.813412 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-5d5c219e-9c01-4f25-b834-fe0afeee8509 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:39.862554 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-97f7d810-54f0-4e81-a0b4-7b9847e52cb3 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ef89109e-351b-4914-8259-2203a37cd402"}} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:11:39.863596 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-97f7d810-54f0-4e81-a0b4-7b9847e52cb3 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b41a4b2b-9dc1-4a39-add0-62f256d162d2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:11:39.870027 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-97f7d810-54f0-4e81-a0b4-7b9847e52cb3 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:39.870546 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-97f7d810-54f0-4e81-a0b4-7b9847e52cb3 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:39.871306 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-97f7d810-54f0-4e81-a0b4-7b9847e52cb3 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:39.871852 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-97f7d810-54f0-4e81-a0b4-7b9847e52cb3 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:39.943365 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-5d5c219e-9c01-4f25-b834-fe0afeee8509 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8472b840794ab8ac0ccd49b2fd1657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0f29cb8f344bbf9fd1b7ffb626bbcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:11:39.951429 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-5d5c219e-9c01-4f25-b834-fe0afeee8509 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] 10.222.0.36 "GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19" status: 200 len: 1358 microversion: 2.1 time: 0.150662 Jul 05 13:11:39.951997 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 544/1093] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:11:39 2022] GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:11:40.552098 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-97f7d810-54f0-4e81-a0b4-7b9847e52cb3 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "POST /compute/v2.1/servers/b41a4b2b-9dc1-4a39-add0-62f256d162d2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.693392 Jul 05 13:11:40.557807 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 550/1094] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Jul 5 13:11:39 2022] POST /compute/v2.1/servers/b41a4b2b-9dc1-4a39-add0-62f256d162d2/os-volume_attachments => generated 194 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 13:11:40.967873 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-9537632f-da24-4fb2-a3ac-7fe86fe39908 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:11:40.968432 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-9537632f-da24-4fb2-a3ac-7fe86fe39908 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] [instance: b83da4e1-8af3-4959-905a-6f3be7e2cf19] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:11:40.974796 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-9537632f-da24-4fb2-a3ac-7fe86fe39908 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:40.975240 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-9537632f-da24-4fb2-a3ac-7fe86fe39908 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:40.976000 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-9537632f-da24-4fb2-a3ac-7fe86fe39908 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:40.976431 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-9537632f-da24-4fb2-a3ac-7fe86fe39908 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:41.108481 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-9537632f-da24-4fb2-a3ac-7fe86fe39908 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8472b840794ab8ac0ccd49b2fd1657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0f29cb8f344bbf9fd1b7ffb626bbcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:11:41.115821 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-9537632f-da24-4fb2-a3ac-7fe86fe39908 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] 10.222.0.36 "GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19" status: 200 len: 1358 microversion: 2.1 time: 0.152511 Jul 05 13:11:41.116373 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 545/1095] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:11:40 2022] GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:11:42.135182 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-4e56c3f5-8692-448c-b13d-0cfcb09849a9 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:11:42.135886 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-4e56c3f5-8692-448c-b13d-0cfcb09849a9 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] [instance: b83da4e1-8af3-4959-905a-6f3be7e2cf19] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:11:42.142609 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4e56c3f5-8692-448c-b13d-0cfcb09849a9 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:42.143064 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4e56c3f5-8692-448c-b13d-0cfcb09849a9 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:42.143831 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4e56c3f5-8692-448c-b13d-0cfcb09849a9 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:42.144270 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4e56c3f5-8692-448c-b13d-0cfcb09849a9 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:42.276981 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-4e56c3f5-8692-448c-b13d-0cfcb09849a9 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8472b840794ab8ac0ccd49b2fd1657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0f29cb8f344bbf9fd1b7ffb626bbcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:11:42.285464 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-4e56c3f5-8692-448c-b13d-0cfcb09849a9 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] 10.222.0.36 "GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19" status: 200 len: 1358 microversion: 2.1 time: 0.155336 Jul 05 13:11:42.286107 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 551/1096] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:11:42 2022] GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:11:43.302914 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-10ea8ff0-2bb2-4b8b-8010-787bcd7178b3 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:11:43.303525 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-10ea8ff0-2bb2-4b8b-8010-787bcd7178b3 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] [instance: b83da4e1-8af3-4959-905a-6f3be7e2cf19] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:11:43.312884 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-10ea8ff0-2bb2-4b8b-8010-787bcd7178b3 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:43.313353 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-10ea8ff0-2bb2-4b8b-8010-787bcd7178b3 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:43.314128 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-10ea8ff0-2bb2-4b8b-8010-787bcd7178b3 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:43.314595 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-10ea8ff0-2bb2-4b8b-8010-787bcd7178b3 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:43.443488 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-10ea8ff0-2bb2-4b8b-8010-787bcd7178b3 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8472b840794ab8ac0ccd49b2fd1657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0f29cb8f344bbf9fd1b7ffb626bbcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:11:43.450879 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-10ea8ff0-2bb2-4b8b-8010-787bcd7178b3 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] 10.222.0.36 "GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19" status: 200 len: 1358 microversion: 2.1 time: 0.151803 Jul 05 13:11:43.451434 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 546/1097] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:11:43 2022] GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:11:44.005536 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-69f9ead1-47ca-450a-ab7e-9bd795a55cba req-e0743827-2d9b-4247-a6eb-8bc1875d4a4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b83da4e1-8af3-4959-905a-6f3be7e2cf19", "name": "network-vif-plugged", "status": "completed", "tag": "6058ab7a-1269-4b24-bfb7-6b0f5686441f"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:11:44.014833 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-69f9ead1-47ca-450a-ab7e-9bd795a55cba req-e0743827-2d9b-4247-a6eb-8bc1875d4a4e service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:44.015278 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-69f9ead1-47ca-450a-ab7e-9bd795a55cba req-e0743827-2d9b-4247-a6eb-8bc1875d4a4e service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:44.025880 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-69f9ead1-47ca-450a-ab7e-9bd795a55cba req-e0743827-2d9b-4247-a6eb-8bc1875d4a4e service nova] Creating event network-vif-plugged:6058ab7a-1269-4b24-bfb7-6b0f5686441f for instance b83da4e1-8af3-4959-905a-6f3be7e2cf19 on hv-cinder-79760 Jul 05 13:11:44.031299 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-69f9ead1-47ca-450a-ab7e-9bd795a55cba req-e0743827-2d9b-4247-a6eb-8bc1875d4a4e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029496 Jul 05 13:11:44.031915 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 552/1098] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:11:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:11:44.467784 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-c74b8671-ae49-4aaf-968f-2f85b40723ed tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:11:44.468390 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-c74b8671-ae49-4aaf-968f-2f85b40723ed tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] [instance: b83da4e1-8af3-4959-905a-6f3be7e2cf19] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:11:44.474896 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-c74b8671-ae49-4aaf-968f-2f85b40723ed tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:44.475266 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-c74b8671-ae49-4aaf-968f-2f85b40723ed tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:44.476045 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-c74b8671-ae49-4aaf-968f-2f85b40723ed tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:44.476472 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-c74b8671-ae49-4aaf-968f-2f85b40723ed tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:44.607085 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-c74b8671-ae49-4aaf-968f-2f85b40723ed tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8472b840794ab8ac0ccd49b2fd1657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0f29cb8f344bbf9fd1b7ffb626bbcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:11:44.616139 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-c74b8671-ae49-4aaf-968f-2f85b40723ed tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] 10.222.0.36 "GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19" status: 200 len: 1358 microversion: 2.1 time: 0.152751 Jul 05 13:11:44.616769 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 547/1099] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:11:44 2022] GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:11:45.634728 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-a9502752-6e0a-4b0a-b9fc-0203f1f2a90c tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:11:45.635418 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-a9502752-6e0a-4b0a-b9fc-0203f1f2a90c tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] [instance: b83da4e1-8af3-4959-905a-6f3be7e2cf19] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:11:45.642610 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a9502752-6e0a-4b0a-b9fc-0203f1f2a90c tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:45.643056 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a9502752-6e0a-4b0a-b9fc-0203f1f2a90c tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:45.643811 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a9502752-6e0a-4b0a-b9fc-0203f1f2a90c tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:45.644242 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a9502752-6e0a-4b0a-b9fc-0203f1f2a90c tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:45.773139 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-a9502752-6e0a-4b0a-b9fc-0203f1f2a90c tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8472b840794ab8ac0ccd49b2fd1657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0f29cb8f344bbf9fd1b7ffb626bbcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:11:45.781275 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-a9502752-6e0a-4b0a-b9fc-0203f1f2a90c tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] 10.222.0.36 "GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19" status: 200 len: 1358 microversion: 2.1 time: 0.150659 Jul 05 13:11:45.781851 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 553/1100] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:11:45 2022] GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:11:46.566277 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-fc299d46-341f-4591-9e69-3d30c0e223c5 req-ed93f832-362e-4b7a-9683-4d530a4fac5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "674489a9-05f1-4c27-a967-516c16c992b1", "tag": "c9bcf6d5-2b90-4b96-80fa-89a15cf69f8c"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:11:46.569695 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-d8f5153b-34a0-458a-9df3-96f5cdde837b tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:11:46.570184 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-d8f5153b-34a0-458a-9df3-96f5cdde837b tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: 674489a9-05f1-4c27-a967-516c16c992b1] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:11:46.580324 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-d8f5153b-34a0-458a-9df3-96f5cdde837b tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:46.580810 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-d8f5153b-34a0-458a-9df3-96f5cdde837b tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:46.581653 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-d8f5153b-34a0-458a-9df3-96f5cdde837b tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:46.582169 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-d8f5153b-34a0-458a-9df3-96f5cdde837b tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:46.584647 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-fc299d46-341f-4591-9e69-3d30c0e223c5 req-ed93f832-362e-4b7a-9683-4d530a4fac5b service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:46.585268 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-fc299d46-341f-4591-9e69-3d30c0e223c5 req-ed93f832-362e-4b7a-9683-4d530a4fac5b service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:46.596766 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-fc299d46-341f-4591-9e69-3d30c0e223c5 req-ed93f832-362e-4b7a-9683-4d530a4fac5b service nova] Creating event network-changed:c9bcf6d5-2b90-4b96-80fa-89a15cf69f8c for instance 674489a9-05f1-4c27-a967-516c16c992b1 on hv-cinder-79760 Jul 05 13:11:46.601924 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-fc299d46-341f-4591-9e69-3d30c0e223c5 req-ed93f832-362e-4b7a-9683-4d530a4fac5b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039410 Jul 05 13:11:46.602834 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 554/1101] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:11:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 13:11:46.611164 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-d8f5153b-34a0-458a-9df3-96f5cdde837b tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: 674489a9-05f1-4c27-a967-516c16c992b1] Going to try to terminate instance {{(pid=118386) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 13:11:46.799237 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-bf035bdb-50d8-4932-97f1-e831440b05cc tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:11:46.799968 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-bf035bdb-50d8-4932-97f1-e831440b05cc tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] [instance: b83da4e1-8af3-4959-905a-6f3be7e2cf19] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:11:46.806164 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-bf035bdb-50d8-4932-97f1-e831440b05cc tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:46.806616 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-bf035bdb-50d8-4932-97f1-e831440b05cc tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:46.807389 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-bf035bdb-50d8-4932-97f1-e831440b05cc tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:46.807826 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-bf035bdb-50d8-4932-97f1-e831440b05cc tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:46.968327 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-bf035bdb-50d8-4932-97f1-e831440b05cc tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8472b840794ab8ac0ccd49b2fd1657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0f29cb8f344bbf9fd1b7ffb626bbcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:11:46.977237 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-bf035bdb-50d8-4932-97f1-e831440b05cc tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] 10.222.0.36 "GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19" status: 200 len: 1548 microversion: 2.1 time: 0.182669 Jul 05 13:11:46.988617 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 555/1102] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:11:46 2022] GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19 => generated 1548 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:11:46.991668 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-d8f5153b-34a0-458a-9df3-96f5cdde837b tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "DELETE /compute/v2.1/servers/674489a9-05f1-4c27-a967-516c16c992b1" status: 204 len: 0 microversion: 2.1 time: 0.433336 Jul 05 13:11:46.996996 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 548/1103] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jul 5 13:11:46 2022] DELETE /compute/v2.1/servers/674489a9-05f1-4c27-a967-516c16c992b1 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 05 13:11:47.000196 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-7a5466ea-6e0e-4b28-8359-099f30e49e93 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:11:47.002162 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-690e66d9-bc95-4c41-a136-ac91dd5d4a87 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:11:47.002856 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-690e66d9-bc95-4c41-a136-ac91dd5d4a87 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: 674489a9-05f1-4c27-a967-516c16c992b1] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:11:47.004848 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-7a5466ea-6e0e-4b28-8359-099f30e49e93 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] [instance: b83da4e1-8af3-4959-905a-6f3be7e2cf19] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:11:47.009096 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-690e66d9-bc95-4c41-a136-ac91dd5d4a87 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:47.009542 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-690e66d9-bc95-4c41-a136-ac91dd5d4a87 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:47.010309 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-690e66d9-bc95-4c41-a136-ac91dd5d4a87 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:47.011285 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-690e66d9-bc95-4c41-a136-ac91dd5d4a87 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:47.019215 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7a5466ea-6e0e-4b28-8359-099f30e49e93 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:47.019861 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7a5466ea-6e0e-4b28-8359-099f30e49e93 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:47.020688 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7a5466ea-6e0e-4b28-8359-099f30e49e93 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:47.021134 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7a5466ea-6e0e-4b28-8359-099f30e49e93 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:47.232726 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-7a5466ea-6e0e-4b28-8359-099f30e49e93 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8472b840794ab8ac0ccd49b2fd1657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0f29cb8f344bbf9fd1b7ffb626bbcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:11:47.237110 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-690e66d9-bc95-4c41-a136-ac91dd5d4a87 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661062780f5c45d180a05e402fc7bc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277fa3c89dff47b88894b781ff69fb70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:11:47.244383 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-7a5466ea-6e0e-4b28-8359-099f30e49e93 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] 10.222.0.36 "GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19" status: 200 len: 1548 microversion: 2.1 time: 0.248081 Jul 05 13:11:47.248908 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 556/1104] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:11:46 2022] GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19 => generated 1548 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:11:47.250462 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-690e66d9-bc95-4c41-a136-ac91dd5d4a87 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/674489a9-05f1-4c27-a967-516c16c992b1" status: 200 len: 1579 microversion: 2.1 time: 0.251683 Jul 05 13:11:47.250462 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 549/1105] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:11:46 2022] GET /compute/v2.1/servers/674489a9-05f1-4c27-a967-516c16c992b1 => generated 1579 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:11:47.262430 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-b750d2f1-21ad-4bff-9ba3-305859669c12 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:11:47.266891 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-b750d2f1-21ad-4bff-9ba3-305859669c12 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dc8472b840794ab8ac0ccd49b2fd1657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0f29cb8f344bbf9fd1b7ffb626bbcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:11:47.267776 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-b750d2f1-21ad-4bff-9ba3-305859669c12 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Searching by: {'deleted': False, 'project_id': '4e0f29cb8f344bbf9fd1b7ffb626bbcb'} {{(pid=118387) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 05 13:11:47.275273 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b750d2f1-21ad-4bff-9ba3-305859669c12 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:47.277298 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b750d2f1-21ad-4bff-9ba3-305859669c12 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:47.277298 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b750d2f1-21ad-4bff-9ba3-305859669c12 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:47.277298 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b750d2f1-21ad-4bff-9ba3-305859669c12 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:47.376644 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.multi_cell_list [None req-b750d2f1-21ad-4bff-9ba3-305859669c12 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118387) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 05 13:11:47.471322 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-b750d2f1-21ad-4bff-9ba3-305859669c12 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.213942 Jul 05 13:11:47.472300 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 557/1106] 10.222.0.36 () {58 vars in 1124 bytes} [Tue Jul 5 13:11:47 2022] GET /compute/v2.1/servers => generated 343 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:11:47.482978 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-122c04a0-1a5e-4011-8cec-9ff5b6f47f6e tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:11:47.483883 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-122c04a0-1a5e-4011-8cec-9ff5b6f47f6e tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] [instance: b83da4e1-8af3-4959-905a-6f3be7e2cf19] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:11:47.490578 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-122c04a0-1a5e-4011-8cec-9ff5b6f47f6e tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:47.491025 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-122c04a0-1a5e-4011-8cec-9ff5b6f47f6e tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:47.491795 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-122c04a0-1a5e-4011-8cec-9ff5b6f47f6e tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:47.492243 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-122c04a0-1a5e-4011-8cec-9ff5b6f47f6e tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:47.626455 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-122c04a0-1a5e-4011-8cec-9ff5b6f47f6e tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8472b840794ab8ac0ccd49b2fd1657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0f29cb8f344bbf9fd1b7ffb626bbcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:11:47.635503 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-122c04a0-1a5e-4011-8cec-9ff5b6f47f6e tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] 10.222.0.36 "GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19" status: 200 len: 1548 microversion: 2.1 time: 0.157255 Jul 05 13:11:47.636097 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 550/1107] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:11:47 2022] GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19 => generated 1548 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:11:48.272957 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-fb5b3bcf-7ca1-4a34-903d-951ed9176556 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:11:48.273602 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-fb5b3bcf-7ca1-4a34-903d-951ed9176556 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: 674489a9-05f1-4c27-a967-516c16c992b1] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:11:48.280779 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-fb5b3bcf-7ca1-4a34-903d-951ed9176556 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:48.281232 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-fb5b3bcf-7ca1-4a34-903d-951ed9176556 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:48.282000 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-fb5b3bcf-7ca1-4a34-903d-951ed9176556 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:48.282439 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-fb5b3bcf-7ca1-4a34-903d-951ed9176556 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:48.434240 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-fb5b3bcf-7ca1-4a34-903d-951ed9176556 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661062780f5c45d180a05e402fc7bc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277fa3c89dff47b88894b781ff69fb70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:11:48.436721 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:11:48.443170 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-fb5b3bcf-7ca1-4a34-903d-951ed9176556 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/674489a9-05f1-4c27-a967-516c16c992b1" status: 200 len: 1579 microversion: 2.1 time: 0.174155 Jul 05 13:11:48.448661 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 558/1108] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:11:48 2022] GET /compute/v2.1/servers/674489a9-05f1-4c27-a967-516c16c992b1 => generated 1579 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:11:49.162950 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-0fb9d199-9897-4f72-b51b-a6405edc4924 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:11:49.163924 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-0fb9d199-9897-4f72-b51b-a6405edc4924 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b41a4b2b-9dc1-4a39-add0-62f256d162d2] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:11:49.170430 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-0fb9d199-9897-4f72-b51b-a6405edc4924 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:49.177231 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-0fb9d199-9897-4f72-b51b-a6405edc4924 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:49.177231 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-0fb9d199-9897-4f72-b51b-a6405edc4924 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:49.177231 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-0fb9d199-9897-4f72-b51b-a6405edc4924 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:49.202142 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-0fb9d199-9897-4f72-b51b-a6405edc4924 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b41a4b2b-9dc1-4a39-add0-62f256d162d2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043046 Jul 05 13:11:49.202906 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 551/1109] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jul 5 13:11:49 2022] GET /compute/v2.1/servers/b41a4b2b-9dc1-4a39-add0-62f256d162d2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 13:11:49.212703 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-7995c59b-5d76-4edc-ab91-76715e6c78c0 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:11:49.213207 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-7995c59b-5d76-4edc-ab91-76715e6c78c0 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b41a4b2b-9dc1-4a39-add0-62f256d162d2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:11:49.219931 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7995c59b-5d76-4edc-ab91-76715e6c78c0 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:49.220510 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7995c59b-5d76-4edc-ab91-76715e6c78c0 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:49.221181 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7995c59b-5d76-4edc-ab91-76715e6c78c0 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:49.221622 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7995c59b-5d76-4edc-ab91-76715e6c78c0 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:49.258633 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-7995c59b-5d76-4edc-ab91-76715e6c78c0 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b41a4b2b-9dc1-4a39-add0-62f256d162d2/os-volume_attachments/ef89109e-351b-4914-8259-2203a37cd402" status: 200 len: 194 microversion: 2.1 time: 0.049806 Jul 05 13:11:49.259239 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 559/1110] 10.222.0.36 () {58 vars in 1412 bytes} [Tue Jul 5 13:11:49 2022] GET /compute/v2.1/servers/b41a4b2b-9dc1-4a39-add0-62f256d162d2/os-volume_attachments/ef89109e-351b-4914-8259-2203a37cd402 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:11:49.446363 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [req-2b942546-3ef8-4904-ba68-cf474dffb7fe req-85887cdb-2ca8-4940-a864-f76870fc3f9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "674489a9-05f1-4c27-a967-516c16c992b1", "name": "network-vif-deleted", "tag": "c9bcf6d5-2b90-4b96-80fa-89a15cf69f8c"}]} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:11:49.455404 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-2b942546-3ef8-4904-ba68-cf474dffb7fe req-85887cdb-2ca8-4940-a864-f76870fc3f9a service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:49.456138 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-2b942546-3ef8-4904-ba68-cf474dffb7fe req-85887cdb-2ca8-4940-a864-f76870fc3f9a service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:49.460108 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-83c5277c-8a94-4a32-a06f-ac35be5e3ff9 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:11:49.460766 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-83c5277c-8a94-4a32-a06f-ac35be5e3ff9 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: 674489a9-05f1-4c27-a967-516c16c992b1] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:11:49.468138 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-83c5277c-8a94-4a32-a06f-ac35be5e3ff9 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:49.468623 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-83c5277c-8a94-4a32-a06f-ac35be5e3ff9 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:49.468773 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.compute.server_external_events [req-2b942546-3ef8-4904-ba68-cf474dffb7fe req-85887cdb-2ca8-4940-a864-f76870fc3f9a service nova] Creating event network-vif-deleted:c9bcf6d5-2b90-4b96-80fa-89a15cf69f8c for instance 674489a9-05f1-4c27-a967-516c16c992b1 on hv-cinder-79760 Jul 05 13:11:49.471739 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-83c5277c-8a94-4a32-a06f-ac35be5e3ff9 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:49.472201 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-83c5277c-8a94-4a32-a06f-ac35be5e3ff9 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:49.475381 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [req-2b942546-3ef8-4904-ba68-cf474dffb7fe req-85887cdb-2ca8-4940-a864-f76870fc3f9a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032791 Jul 05 13:11:49.476162 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 552/1111] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:11:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:11:49.539916 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-83c5277c-8a94-4a32-a06f-ac35be5e3ff9 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661062780f5c45d180a05e402fc7bc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277fa3c89dff47b88894b781ff69fb70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:11:49.548293 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-83c5277c-8a94-4a32-a06f-ac35be5e3ff9 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/674489a9-05f1-4c27-a967-516c16c992b1" status: 200 len: 1393 microversion: 2.1 time: 0.091935 Jul 05 13:11:49.548886 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 560/1112] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:11:49 2022] GET /compute/v2.1/servers/674489a9-05f1-4c27-a967-516c16c992b1 => generated 1393 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:11:49.647933 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-2c76401c-2173-48cc-be3a-7080edeca6b0 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9aec6286-2e92-43a7-8b70-df577b068855"}} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:11:49.649153 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-2c76401c-2173-48cc-be3a-7080edeca6b0 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] [instance: b83da4e1-8af3-4959-905a-6f3be7e2cf19] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:11:49.655876 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-2c76401c-2173-48cc-be3a-7080edeca6b0 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:49.656469 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-2c76401c-2173-48cc-be3a-7080edeca6b0 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:49.657457 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-2c76401c-2173-48cc-be3a-7080edeca6b0 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:49.657897 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-2c76401c-2173-48cc-be3a-7080edeca6b0 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:50.047777 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:11:50.566063 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-3b9a3644-4313-49dc-8916-5e2eee8ee3ce tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:11:50.566787 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-3b9a3644-4313-49dc-8916-5e2eee8ee3ce tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: 674489a9-05f1-4c27-a967-516c16c992b1] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:11:50.574155 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3b9a3644-4313-49dc-8916-5e2eee8ee3ce tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:50.574606 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3b9a3644-4313-49dc-8916-5e2eee8ee3ce tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:50.575373 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3b9a3644-4313-49dc-8916-5e2eee8ee3ce tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:50.575807 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3b9a3644-4313-49dc-8916-5e2eee8ee3ce tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:50.606560 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3b9a3644-4313-49dc-8916-5e2eee8ee3ce tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:50.607539 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3b9a3644-4313-49dc-8916-5e2eee8ee3ce tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:50.607728 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.objects.instance [None req-3b9a3644-4313-49dc-8916-5e2eee8ee3ce tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lazy-loading 'fault' on Instance uuid 674489a9-05f1-4c27-a967-516c16c992b1 {{(pid=118387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 13:11:50.623328 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-2c76401c-2173-48cc-be3a-7080edeca6b0 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] 10.222.0.36 "POST /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.980291 Jul 05 13:11:50.624556 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 553/1113] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Jul 5 13:11:49 2022] POST /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19/os-volume_attachments => generated 194 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:11:50.661312 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-3b9a3644-4313-49dc-8916-5e2eee8ee3ce tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661062780f5c45d180a05e402fc7bc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277fa3c89dff47b88894b781ff69fb70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:11:50.669693 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-3b9a3644-4313-49dc-8916-5e2eee8ee3ce tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/674489a9-05f1-4c27-a967-516c16c992b1" status: 200 len: 1231 microversion: 2.1 time: 0.107766 Jul 05 13:11:50.670259 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 561/1114] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:11:50 2022] GET /compute/v2.1/servers/674489a9-05f1-4c27-a967-516c16c992b1 => generated 1231 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:11:50.984958 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-901e1d71-2b6e-4b60-b4b5-67eb9f4c2e22 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3bfe2575-e592-4678-99e4-c191f51a348b"}} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:11:50.986189 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-901e1d71-2b6e-4b60-b4b5-67eb9f4c2e22 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b41a4b2b-9dc1-4a39-add0-62f256d162d2] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:11:50.992363 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-901e1d71-2b6e-4b60-b4b5-67eb9f4c2e22 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:50.992849 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-901e1d71-2b6e-4b60-b4b5-67eb9f4c2e22 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:50.993603 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-901e1d71-2b6e-4b60-b4b5-67eb9f4c2e22 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:50.994038 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-901e1d71-2b6e-4b60-b4b5-67eb9f4c2e22 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:51.691362 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-c0e3ad7f-4661-455a-bb62-9efad1c3fa9e tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:11:51.691980 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-c0e3ad7f-4661-455a-bb62-9efad1c3fa9e tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: 674489a9-05f1-4c27-a967-516c16c992b1] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:11:51.699160 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c0e3ad7f-4661-455a-bb62-9efad1c3fa9e tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:51.699610 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c0e3ad7f-4661-455a-bb62-9efad1c3fa9e tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:51.700378 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c0e3ad7f-4661-455a-bb62-9efad1c3fa9e tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:51.700839 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c0e3ad7f-4661-455a-bb62-9efad1c3fa9e tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:51.715113 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.wsgi [None req-c0e3ad7f-4661-455a-bb62-9efad1c3fa9e tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] HTTP exception thrown: Instance 674489a9-05f1-4c27-a967-516c16c992b1 could not be found. Jul 05 13:11:51.716626 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-c0e3ad7f-4661-455a-bb62-9efad1c3fa9e tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Request method failure captured: Jul 05 13:11:51.716626 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: request: GET /compute/v2.1/servers/674489a9-05f1-4c27-a967-516c16c992b1 HTTP/1.1 Jul 05 13:11:51.716626 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept: application/json Jul 05 13:11:51.716626 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept-Encoding: identity Jul 05 13:11:51.716626 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Connection: close Jul 05 13:11:51.716626 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Length: 0 Jul 05 13:11:51.716626 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Type: application/json Jul 05 13:11:51.716626 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Host: 10.222.0.36 Jul 05 13:11:51.716626 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Openstack-System-Scope: None Jul 05 13:11:51.716626 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: User-Agent: python-urllib3/1.26.9 Jul 05 13:11:51.716626 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Auth-Token: gAAAAABixDbHzxrNn2lrBPEZh092wnZ2gE7LtmxuF4JSZVsPZKEavBss92px7GMxGXF0VBkurmr11L6TG6RF8h6Duo7dMSMY0qzV8b_J9Orq0Ml5zDOld7rA4VneT6r7i1irMLipQGpBEy1MEss_XpDOHSnalPxalqpcArH4LoQ5ISJh4SfaUOM Jul 05 13:11:51.716626 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Id: None Jul 05 13:11:51.716626 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Name: None Jul 05 13:11:51.716626 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Identity-Status: Confirmed Jul 05 13:11:51.716626 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Is-Admin-Project: True Jul 05 13:11:51.716626 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Id: default Jul 05 13:11:51.716626 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Name: Default Jul 05 13:11:51.716626 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Id: 277fa3c89dff47b88894b781ff69fb70 Jul 05 13:11:51.716626 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Name: tempest-TestVolumeBootPattern-848454944 Jul 05 13:11:51.716626 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Role: member,reader Jul 05 13:11:51.716626 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Roles: member,reader Jul 05 13:11:51.718195 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/277fa3c89dff47b88894b781ff69fb70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_277fa3c89dff47b88894b781ff69fb70", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/277fa3c89dff47b88894b781ff69fb70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/277fa3c89dff47b88894b781ff69fb70"}]}] Jul 05 13:11:51.718195 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant: tempest-TestVolumeBootPattern-848454944 Jul 05 13:11:51.718195 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Id: 277fa3c89dff47b88894b781ff69fb70 Jul 05 13:11:51.718195 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Name: tempest-TestVolumeBootPattern-848454944 Jul 05 13:11:51.718195 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User: tempest-TestVolumeBootPattern-848454944-project Jul 05 13:11:51.718195 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Id: default Jul 05 13:11:51.718195 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Name: Default Jul 05 13:11:51.718195 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Id: 661062780f5c45d180a05e402fc7bc27 Jul 05 13:11:51.718195 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Name: tempest-TestVolumeBootPattern-848454944-project Jul 05 13:11:51.718195 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: method: > Jul 05 13:11:51.718195 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: exception: Instance 674489a9-05f1-4c27-a967-516c16c992b1 could not be found. Jul 05 13:11:51.718195 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: action_args: {'id': '674489a9-05f1-4c27-a967-516c16c992b1'} Jul 05 13:11:51.718988 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 13:11:51.718988 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:11:51.718988 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 13:11:51.718988 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 13:11:51.718988 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 13:11:51.718988 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 13:11:51.718988 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 13:11:51.718988 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 13:11:51.718988 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 13:11:51.718988 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 13:11:51.718988 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 674489a9-05f1-4c27-a967-516c16c992b1 could not be found. Jul 05 13:11:51.718988 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:11:51.718988 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:11:51.718988 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:11:51.718988 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:11:51.718988 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:11:51.718988 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:11:51.718988 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 13:11:51.718988 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 13:11:51.718988 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 13:11:51.720345 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 13:11:51.720345 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 13:11:51.720345 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 13:11:51.720345 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 13:11:51.720345 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 13:11:51.720345 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 13:11:51.720345 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 13:11:51.720345 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 674489a9-05f1-4c27-a967-516c16c992b1 could not be found. Jul 05 13:11:51.720345 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:11:51.720345 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:11:51.720345 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:11:51.720345 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:11:51.720345 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:11:51.720345 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:11:51.720345 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 13:11:51.720345 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 13:11:51.720345 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 674489a9-05f1-4c27-a967-516c16c992b1 could not be found. Jul 05 13:11:51.720345 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:11:51.721609 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-c0e3ad7f-4661-455a-bb62-9efad1c3fa9e tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Returning 404 to user: Instance 674489a9-05f1-4c27-a967-516c16c992b1 could not be found. {{(pid=118387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 13:11:51.721609 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-c0e3ad7f-4661-455a-bb62-9efad1c3fa9e tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/674489a9-05f1-4c27-a967-516c16c992b1" status: 404 len: 111 microversion: 2.1 time: 0.030705 Jul 05 13:11:51.721609 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 562/1115] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:11:51 2022] GET /compute/v2.1/servers/674489a9-05f1-4c27-a967-516c16c992b1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 05 13:11:51.827146 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-901e1d71-2b6e-4b60-b4b5-67eb9f4c2e22 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "POST /compute/v2.1/servers/b41a4b2b-9dc1-4a39-add0-62f256d162d2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.846420 Jul 05 13:11:51.827829 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 554/1116] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Jul 5 13:11:50 2022] POST /compute/v2.1/servers/b41a4b2b-9dc1-4a39-add0-62f256d162d2/os-volume_attachments => generated 194 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:11:55.107969 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-396a56bd-ba93-438a-8ec2-ed67474bd896 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:11:55.108500 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-396a56bd-ba93-438a-8ec2-ed67474bd896 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: 0bcc1600-ecfa-4cf0-929c-03cd036d07c3] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:11:55.110828 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=1 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:11:55.111722 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [req-41b80106-a68b-49c8-b645-6a837aec2bdf req-19bfe730-865d-4a88-9b5c-d952abc5b4d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bcc1600-ecfa-4cf0-929c-03cd036d07c3", "tag": "d010e1f8-d442-4111-a65d-8c9e9e080c9f"}]} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:11:55.115956 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:11:55.116661 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-396a56bd-ba93-438a-8ec2-ed67474bd896 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:55.117319 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-396a56bd-ba93-438a-8ec2-ed67474bd896 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:55.118093 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-396a56bd-ba93-438a-8ec2-ed67474bd896 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:55.118526 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-396a56bd-ba93-438a-8ec2-ed67474bd896 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:55.125491 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-41b80106-a68b-49c8-b645-6a837aec2bdf req-19bfe730-865d-4a88-9b5c-d952abc5b4d1 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:55.126164 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-41b80106-a68b-49c8-b645-6a837aec2bdf req-19bfe730-865d-4a88-9b5c-d952abc5b4d1 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:55.137754 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.compute.server_external_events [req-41b80106-a68b-49c8-b645-6a837aec2bdf req-19bfe730-865d-4a88-9b5c-d952abc5b4d1 service nova] Creating event network-changed:d010e1f8-d442-4111-a65d-8c9e9e080c9f for instance 0bcc1600-ecfa-4cf0-929c-03cd036d07c3 on hv-cinder-79760 Jul 05 13:11:55.142803 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [req-41b80106-a68b-49c8-b645-6a837aec2bdf req-19bfe730-865d-4a88-9b5c-d952abc5b4d1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036259 Jul 05 13:11:55.143626 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 555/1117] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:11:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 13:11:55.143745 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-396a56bd-ba93-438a-8ec2-ed67474bd896 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: 0bcc1600-ecfa-4cf0-929c-03cd036d07c3] Going to try to terminate instance {{(pid=118387) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 13:11:55.451451 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-396a56bd-ba93-438a-8ec2-ed67474bd896 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "DELETE /compute/v2.1/servers/0bcc1600-ecfa-4cf0-929c-03cd036d07c3" status: 204 len: 0 microversion: 2.1 time: 0.348236 Jul 05 13:11:55.452135 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 563/1118] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jul 5 13:11:55 2022] DELETE /compute/v2.1/servers/0bcc1600-ecfa-4cf0-929c-03cd036d07c3 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 05 13:11:55.460659 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-cc7001de-e8e0-4220-a3d6-9a49a9743ec5 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:11:55.461799 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-cc7001de-e8e0-4220-a3d6-9a49a9743ec5 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: 0bcc1600-ecfa-4cf0-929c-03cd036d07c3] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:11:55.469410 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-cc7001de-e8e0-4220-a3d6-9a49a9743ec5 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:55.470125 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-cc7001de-e8e0-4220-a3d6-9a49a9743ec5 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:55.471127 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-cc7001de-e8e0-4220-a3d6-9a49a9743ec5 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:55.471791 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-cc7001de-e8e0-4220-a3d6-9a49a9743ec5 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:55.614102 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-cc7001de-e8e0-4220-a3d6-9a49a9743ec5 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661062780f5c45d180a05e402fc7bc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277fa3c89dff47b88894b781ff69fb70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:11:55.621660 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-cc7001de-e8e0-4220-a3d6-9a49a9743ec5 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/0bcc1600-ecfa-4cf0-929c-03cd036d07c3" status: 200 len: 1578 microversion: 2.1 time: 0.165061 Jul 05 13:11:55.622225 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 556/1119] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:11:55 2022] GET /compute/v2.1/servers/0bcc1600-ecfa-4cf0-929c-03cd036d07c3 => generated 1578 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:11:56.639342 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-0064bcdd-3816-450e-911b-bb94c475fe86 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:11:56.640009 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-0064bcdd-3816-450e-911b-bb94c475fe86 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: 0bcc1600-ecfa-4cf0-929c-03cd036d07c3] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:11:56.646461 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0064bcdd-3816-450e-911b-bb94c475fe86 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:56.646908 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0064bcdd-3816-450e-911b-bb94c475fe86 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:56.647696 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0064bcdd-3816-450e-911b-bb94c475fe86 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:56.648131 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0064bcdd-3816-450e-911b-bb94c475fe86 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:56.782079 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-0064bcdd-3816-450e-911b-bb94c475fe86 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661062780f5c45d180a05e402fc7bc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277fa3c89dff47b88894b781ff69fb70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:11:56.789725 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-0064bcdd-3816-450e-911b-bb94c475fe86 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/0bcc1600-ecfa-4cf0-929c-03cd036d07c3" status: 200 len: 1578 microversion: 2.1 time: 0.154675 Jul 05 13:11:56.790285 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 564/1120] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:11:56 2022] GET /compute/v2.1/servers/0bcc1600-ecfa-4cf0-929c-03cd036d07c3 => generated 1578 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:11:57.807089 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-0c75a99b-3ca1-4f2d-ba04-cd1adbe41c72 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:11:57.809016 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-0c75a99b-3ca1-4f2d-ba04-cd1adbe41c72 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: 0bcc1600-ecfa-4cf0-929c-03cd036d07c3] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:11:57.816442 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-0c75a99b-3ca1-4f2d-ba04-cd1adbe41c72 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:57.817231 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-0c75a99b-3ca1-4f2d-ba04-cd1adbe41c72 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:57.818232 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-0c75a99b-3ca1-4f2d-ba04-cd1adbe41c72 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:57.819200 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-0c75a99b-3ca1-4f2d-ba04-cd1adbe41c72 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:57.957740 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-0c75a99b-3ca1-4f2d-ba04-cd1adbe41c72 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661062780f5c45d180a05e402fc7bc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277fa3c89dff47b88894b781ff69fb70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:11:57.965738 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-0c75a99b-3ca1-4f2d-ba04-cd1adbe41c72 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/0bcc1600-ecfa-4cf0-929c-03cd036d07c3" status: 200 len: 1459 microversion: 2.1 time: 0.162336 Jul 05 13:11:57.966313 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 557/1121] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:11:57 2022] GET /compute/v2.1/servers/0bcc1600-ecfa-4cf0-929c-03cd036d07c3 => generated 1459 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:11:58.179330 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-2646ab4d-9a16-427d-b694-588d4daf6b41 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:11:58.180050 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-2646ab4d-9a16-427d-b694-588d4daf6b41 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] [instance: b83da4e1-8af3-4959-905a-6f3be7e2cf19] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:11:58.182140 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell0:SELECT=2 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:11:58.187512 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2646ab4d-9a16-427d-b694-588d4daf6b41 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:58.187955 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2646ab4d-9a16-427d-b694-588d4daf6b41 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:58.188758 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2646ab4d-9a16-427d-b694-588d4daf6b41 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:58.189204 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2646ab4d-9a16-427d-b694-588d4daf6b41 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:58.324318 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-2646ab4d-9a16-427d-b694-588d4daf6b41 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8472b840794ab8ac0ccd49b2fd1657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0f29cb8f344bbf9fd1b7ffb626bbcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:11:58.335009 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-2646ab4d-9a16-427d-b694-588d4daf6b41 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] 10.222.0.36 "GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19" status: 200 len: 1594 microversion: 2.1 time: 0.159548 Jul 05 13:11:58.335579 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 565/1122] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:11:58 2022] GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19 => generated 1594 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:11:58.365072 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [req-c6da5f12-f071-4b99-86fd-ec764f44cc19 req-a600cf0b-c521-49ce-a253-b6469809b110 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bcc1600-ecfa-4cf0-929c-03cd036d07c3", "name": "network-vif-deleted", "tag": "d010e1f8-d442-4111-a65d-8c9e9e080c9f"}]} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:11:58.373963 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-c6da5f12-f071-4b99-86fd-ec764f44cc19 req-a600cf0b-c521-49ce-a253-b6469809b110 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:58.374400 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-c6da5f12-f071-4b99-86fd-ec764f44cc19 req-a600cf0b-c521-49ce-a253-b6469809b110 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:58.386013 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.compute.server_external_events [req-c6da5f12-f071-4b99-86fd-ec764f44cc19 req-a600cf0b-c521-49ce-a253-b6469809b110 service nova] Creating event network-vif-deleted:d010e1f8-d442-4111-a65d-8c9e9e080c9f for instance 0bcc1600-ecfa-4cf0-929c-03cd036d07c3 on hv-cinder-79760 Jul 05 13:11:58.391868 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [req-c6da5f12-f071-4b99-86fd-ec764f44cc19 req-a600cf0b-c521-49ce-a253-b6469809b110 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030415 Jul 05 13:11:58.392756 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 558/1123] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:11:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:11:58.983371 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-3418ea2d-5dd1-4a26-8752-3f4401306408 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:11:58.983979 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-3418ea2d-5dd1-4a26-8752-3f4401306408 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: 0bcc1600-ecfa-4cf0-929c-03cd036d07c3] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:11:58.990153 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3418ea2d-5dd1-4a26-8752-3f4401306408 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:58.990598 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3418ea2d-5dd1-4a26-8752-3f4401306408 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:58.991397 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3418ea2d-5dd1-4a26-8752-3f4401306408 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:58.991828 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3418ea2d-5dd1-4a26-8752-3f4401306408 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:59.022382 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3418ea2d-5dd1-4a26-8752-3f4401306408 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:11:59.022821 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3418ea2d-5dd1-4a26-8752-3f4401306408 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:11:59.023261 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.objects.instance [None req-3418ea2d-5dd1-4a26-8752-3f4401306408 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lazy-loading 'fault' on Instance uuid 0bcc1600-ecfa-4cf0-929c-03cd036d07c3 {{(pid=118387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 13:11:59.070623 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-3418ea2d-5dd1-4a26-8752-3f4401306408 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661062780f5c45d180a05e402fc7bc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277fa3c89dff47b88894b781ff69fb70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:11:59.078920 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-3418ea2d-5dd1-4a26-8752-3f4401306408 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/0bcc1600-ecfa-4cf0-929c-03cd036d07c3" status: 200 len: 1231 microversion: 2.1 time: 0.099783 Jul 05 13:11:59.079485 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 566/1124] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:11:58 2022] GET /compute/v2.1/servers/0bcc1600-ecfa-4cf0-929c-03cd036d07c3 => generated 1231 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:12:00.097820 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-a3dffe87-5995-4a84-9766-e1ccd0d720af tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:12:00.098527 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-a3dffe87-5995-4a84-9766-e1ccd0d720af tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: 0bcc1600-ecfa-4cf0-929c-03cd036d07c3] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:12:00.104715 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a3dffe87-5995-4a84-9766-e1ccd0d720af tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:00.105166 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a3dffe87-5995-4a84-9766-e1ccd0d720af tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:00.105927 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a3dffe87-5995-4a84-9766-e1ccd0d720af tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:00.106361 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-a3dffe87-5995-4a84-9766-e1ccd0d720af tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:00.119809 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.wsgi [None req-a3dffe87-5995-4a84-9766-e1ccd0d720af tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] HTTP exception thrown: Instance 0bcc1600-ecfa-4cf0-929c-03cd036d07c3 could not be found. Jul 05 13:12:00.121513 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-a3dffe87-5995-4a84-9766-e1ccd0d720af tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Request method failure captured: Jul 05 13:12:00.121513 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: request: GET /compute/v2.1/servers/0bcc1600-ecfa-4cf0-929c-03cd036d07c3 HTTP/1.1 Jul 05 13:12:00.121513 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Accept: application/json Jul 05 13:12:00.121513 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Accept-Encoding: identity Jul 05 13:12:00.121513 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Connection: close Jul 05 13:12:00.121513 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Content-Length: 0 Jul 05 13:12:00.121513 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Content-Type: application/json Jul 05 13:12:00.121513 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Host: 10.222.0.36 Jul 05 13:12:00.121513 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Openstack-System-Scope: None Jul 05 13:12:00.121513 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: User-Agent: python-urllib3/1.26.9 Jul 05 13:12:00.121513 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Auth-Token: gAAAAABixDbHzxrNn2lrBPEZh092wnZ2gE7LtmxuF4JSZVsPZKEavBss92px7GMxGXF0VBkurmr11L6TG6RF8h6Duo7dMSMY0qzV8b_J9Orq0Ml5zDOld7rA4VneT6r7i1irMLipQGpBEy1MEss_XpDOHSnalPxalqpcArH4LoQ5ISJh4SfaUOM Jul 05 13:12:00.121513 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Domain-Id: None Jul 05 13:12:00.121513 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Domain-Name: None Jul 05 13:12:00.121513 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Identity-Status: Confirmed Jul 05 13:12:00.121513 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Is-Admin-Project: True Jul 05 13:12:00.121513 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Domain-Id: default Jul 05 13:12:00.121513 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Domain-Name: Default Jul 05 13:12:00.121513 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Id: 277fa3c89dff47b88894b781ff69fb70 Jul 05 13:12:00.121513 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Name: tempest-TestVolumeBootPattern-848454944 Jul 05 13:12:00.121513 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Role: member,reader Jul 05 13:12:00.121513 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Roles: member,reader Jul 05 13:12:00.123129 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/277fa3c89dff47b88894b781ff69fb70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_277fa3c89dff47b88894b781ff69fb70", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/277fa3c89dff47b88894b781ff69fb70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/277fa3c89dff47b88894b781ff69fb70"}]}] Jul 05 13:12:00.123129 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Tenant: tempest-TestVolumeBootPattern-848454944 Jul 05 13:12:00.123129 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Tenant-Id: 277fa3c89dff47b88894b781ff69fb70 Jul 05 13:12:00.123129 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Tenant-Name: tempest-TestVolumeBootPattern-848454944 Jul 05 13:12:00.123129 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User: tempest-TestVolumeBootPattern-848454944-project Jul 05 13:12:00.123129 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Domain-Id: default Jul 05 13:12:00.123129 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Domain-Name: Default Jul 05 13:12:00.123129 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Id: 661062780f5c45d180a05e402fc7bc27 Jul 05 13:12:00.123129 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Name: tempest-TestVolumeBootPattern-848454944-project Jul 05 13:12:00.123129 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: method: > Jul 05 13:12:00.123129 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: exception: Instance 0bcc1600-ecfa-4cf0-929c-03cd036d07c3 could not be found. Jul 05 13:12:00.123129 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: action_args: {'id': '0bcc1600-ecfa-4cf0-929c-03cd036d07c3'} Jul 05 13:12:00.123957 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 13:12:00.123957 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:12:00.123957 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 13:12:00.123957 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 13:12:00.123957 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 13:12:00.123957 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 13:12:00.123957 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 13:12:00.123957 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 13:12:00.123957 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 13:12:00.123957 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 13:12:00.123957 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bcc1600-ecfa-4cf0-929c-03cd036d07c3 could not be found. Jul 05 13:12:00.123957 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:12:00.123957 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:12:00.123957 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:12:00.123957 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:12:00.123957 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:12:00.123957 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:12:00.123957 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 13:12:00.123957 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 13:12:00.123957 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 13:12:00.125317 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 13:12:00.125317 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 13:12:00.125317 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 13:12:00.125317 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 13:12:00.125317 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 13:12:00.125317 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 13:12:00.125317 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 13:12:00.125317 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bcc1600-ecfa-4cf0-929c-03cd036d07c3 could not be found. Jul 05 13:12:00.125317 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:12:00.125317 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:12:00.125317 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:12:00.125317 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:12:00.125317 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:12:00.125317 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:12:00.125317 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 13:12:00.125317 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 13:12:00.125317 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bcc1600-ecfa-4cf0-929c-03cd036d07c3 could not be found. Jul 05 13:12:00.125317 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:12:00.126454 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-a3dffe87-5995-4a84-9766-e1ccd0d720af tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Returning 404 to user: Instance 0bcc1600-ecfa-4cf0-929c-03cd036d07c3 could not be found. {{(pid=118386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 13:12:00.126454 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-a3dffe87-5995-4a84-9766-e1ccd0d720af tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/0bcc1600-ecfa-4cf0-929c-03cd036d07c3" status: 404 len: 111 microversion: 2.1 time: 0.030671 Jul 05 13:12:00.126454 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 559/1125] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:12:00 2022] GET /compute/v2.1/servers/0bcc1600-ecfa-4cf0-929c-03cd036d07c3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 13:12:00.644665 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-11f8355f-d39c-45a0-b0b5-4d1657fc3c9e tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:12:00.645520 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-11f8355f-d39c-45a0-b0b5-4d1657fc3c9e tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: ba68561c-87aa-4ad8-a50c-de2cd1e938e2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:12:00.652160 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-11f8355f-d39c-45a0-b0b5-4d1657fc3c9e tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:00.653570 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-11f8355f-d39c-45a0-b0b5-4d1657fc3c9e tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:00.654355 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-11f8355f-d39c-45a0-b0b5-4d1657fc3c9e tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:00.654787 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-11f8355f-d39c-45a0-b0b5-4d1657fc3c9e tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:00.670766 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.wsgi [None req-11f8355f-d39c-45a0-b0b5-4d1657fc3c9e tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] HTTP exception thrown: Instance ba68561c-87aa-4ad8-a50c-de2cd1e938e2 could not be found. Jul 05 13:12:00.672711 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-11f8355f-d39c-45a0-b0b5-4d1657fc3c9e tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Request method failure captured: Jul 05 13:12:00.672711 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: request: DELETE /compute/v2.1/servers/ba68561c-87aa-4ad8-a50c-de2cd1e938e2 HTTP/1.1 Jul 05 13:12:00.672711 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept: application/json Jul 05 13:12:00.672711 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept-Encoding: identity Jul 05 13:12:00.672711 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Connection: close Jul 05 13:12:00.672711 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Length: 0 Jul 05 13:12:00.672711 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Type: application/json Jul 05 13:12:00.672711 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Host: 10.222.0.36 Jul 05 13:12:00.672711 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Openstack-System-Scope: None Jul 05 13:12:00.672711 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: User-Agent: python-urllib3/1.26.9 Jul 05 13:12:00.672711 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Auth-Token: gAAAAABixDbHzxrNn2lrBPEZh092wnZ2gE7LtmxuF4JSZVsPZKEavBss92px7GMxGXF0VBkurmr11L6TG6RF8h6Duo7dMSMY0qzV8b_J9Orq0Ml5zDOld7rA4VneT6r7i1irMLipQGpBEy1MEss_XpDOHSnalPxalqpcArH4LoQ5ISJh4SfaUOM Jul 05 13:12:00.672711 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Id: None Jul 05 13:12:00.672711 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Name: None Jul 05 13:12:00.672711 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Identity-Status: Confirmed Jul 05 13:12:00.672711 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Is-Admin-Project: True Jul 05 13:12:00.672711 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Id: default Jul 05 13:12:00.672711 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Name: Default Jul 05 13:12:00.672711 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Id: 277fa3c89dff47b88894b781ff69fb70 Jul 05 13:12:00.672711 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Name: tempest-TestVolumeBootPattern-848454944 Jul 05 13:12:00.672711 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Role: member,reader Jul 05 13:12:00.672711 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Roles: member,reader Jul 05 13:12:00.674423 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/277fa3c89dff47b88894b781ff69fb70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_277fa3c89dff47b88894b781ff69fb70", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/277fa3c89dff47b88894b781ff69fb70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/277fa3c89dff47b88894b781ff69fb70"}]}] Jul 05 13:12:00.674423 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant: tempest-TestVolumeBootPattern-848454944 Jul 05 13:12:00.674423 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Id: 277fa3c89dff47b88894b781ff69fb70 Jul 05 13:12:00.674423 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Name: tempest-TestVolumeBootPattern-848454944 Jul 05 13:12:00.674423 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User: tempest-TestVolumeBootPattern-848454944-project Jul 05 13:12:00.674423 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Id: default Jul 05 13:12:00.674423 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Name: Default Jul 05 13:12:00.674423 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Id: 661062780f5c45d180a05e402fc7bc27 Jul 05 13:12:00.674423 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Name: tempest-TestVolumeBootPattern-848454944-project Jul 05 13:12:00.674423 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: method: > Jul 05 13:12:00.674423 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: exception: Instance ba68561c-87aa-4ad8-a50c-de2cd1e938e2 could not be found. Jul 05 13:12:00.674423 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: action_args: {'id': 'ba68561c-87aa-4ad8-a50c-de2cd1e938e2'} Jul 05 13:12:00.675388 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 13:12:00.675388 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:12:00.675388 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 13:12:00.675388 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 13:12:00.675388 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 13:12:00.675388 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 13:12:00.675388 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 13:12:00.675388 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 13:12:00.675388 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 13:12:00.675388 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 13:12:00.675388 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba68561c-87aa-4ad8-a50c-de2cd1e938e2 could not be found. Jul 05 13:12:00.675388 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:12:00.675388 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:12:00.675388 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:12:00.675388 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:12:00.675388 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:12:00.675388 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:12:00.675388 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 13:12:00.675388 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 13:12:00.675388 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 13:12:00.677005 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 13:12:00.677005 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 05 13:12:00.677005 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 05 13:12:00.677005 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 05 13:12:00.677005 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 05 13:12:00.677005 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 13:12:00.677005 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 13:12:00.677005 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 13:12:00.677005 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 13:12:00.677005 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba68561c-87aa-4ad8-a50c-de2cd1e938e2 could not be found. Jul 05 13:12:00.677005 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:12:00.677005 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:12:00.677005 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:12:00.677005 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:12:00.677005 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:12:00.677005 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:12:00.677005 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 13:12:00.677005 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 13:12:00.677005 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba68561c-87aa-4ad8-a50c-de2cd1e938e2 could not be found. Jul 05 13:12:00.677005 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:12:00.678732 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-11f8355f-d39c-45a0-b0b5-4d1657fc3c9e tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Returning 404 to user: Instance ba68561c-87aa-4ad8-a50c-de2cd1e938e2 could not be found. {{(pid=118387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 13:12:00.678732 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-11f8355f-d39c-45a0-b0b5-4d1657fc3c9e tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ba68561c-87aa-4ad8-a50c-de2cd1e938e2" status: 404 len: 111 microversion: 2.1 time: 0.035419 Jul 05 13:12:00.679193 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [req-3b6e50a3-000f-4f46-a10c-775c3e97fbdf req-d755c398-7428-4722-a695-5aad19df8f6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b83da4e1-8af3-4959-905a-6f3be7e2cf19", "tag": "6058ab7a-1269-4b24-bfb7-6b0f5686441f"}]} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:12:00.680776 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 567/1126] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jul 5 13:12:00 2022] DELETE /compute/v2.1/servers/ba68561c-87aa-4ad8-a50c-de2cd1e938e2 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 13:12:00.687495 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-c1d5d0ed-396c-4a5b-8691-c839d7a61af5 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:12:00.688284 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-c1d5d0ed-396c-4a5b-8691-c839d7a61af5 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] [instance: ba68561c-87aa-4ad8-a50c-de2cd1e938e2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:12:00.688767 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-3b6e50a3-000f-4f46-a10c-775c3e97fbdf req-d755c398-7428-4722-a695-5aad19df8f6d service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:00.694593 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-3b6e50a3-000f-4f46-a10c-775c3e97fbdf req-d755c398-7428-4722-a695-5aad19df8f6d service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:00.695277 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c1d5d0ed-396c-4a5b-8691-c839d7a61af5 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:00.695881 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c1d5d0ed-396c-4a5b-8691-c839d7a61af5 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:00.697000 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c1d5d0ed-396c-4a5b-8691-c839d7a61af5 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:00.697590 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c1d5d0ed-396c-4a5b-8691-c839d7a61af5 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:00.701878 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.compute.server_external_events [req-3b6e50a3-000f-4f46-a10c-775c3e97fbdf req-d755c398-7428-4722-a695-5aad19df8f6d service nova] Creating event network-changed:6058ab7a-1269-4b24-bfb7-6b0f5686441f for instance b83da4e1-8af3-4959-905a-6f3be7e2cf19 on hv-cinder-79760 Jul 05 13:12:00.707218 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [req-3b6e50a3-000f-4f46-a10c-775c3e97fbdf req-d755c398-7428-4722-a695-5aad19df8f6d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035095 Jul 05 13:12:00.712164 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 560/1127] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:12:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 13:12:00.713956 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.wsgi [None req-c1d5d0ed-396c-4a5b-8691-c839d7a61af5 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] HTTP exception thrown: Instance ba68561c-87aa-4ad8-a50c-de2cd1e938e2 could not be found. Jul 05 13:12:00.715569 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-c1d5d0ed-396c-4a5b-8691-c839d7a61af5 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Request method failure captured: Jul 05 13:12:00.715569 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: request: GET /compute/v2.1/servers/ba68561c-87aa-4ad8-a50c-de2cd1e938e2 HTTP/1.1 Jul 05 13:12:00.715569 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept: application/json Jul 05 13:12:00.715569 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept-Encoding: identity Jul 05 13:12:00.715569 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Connection: close Jul 05 13:12:00.715569 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Length: 0 Jul 05 13:12:00.715569 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Type: application/json Jul 05 13:12:00.715569 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Host: 10.222.0.36 Jul 05 13:12:00.715569 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Openstack-System-Scope: None Jul 05 13:12:00.715569 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: User-Agent: python-urllib3/1.26.9 Jul 05 13:12:00.715569 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Auth-Token: gAAAAABixDbHzxrNn2lrBPEZh092wnZ2gE7LtmxuF4JSZVsPZKEavBss92px7GMxGXF0VBkurmr11L6TG6RF8h6Duo7dMSMY0qzV8b_J9Orq0Ml5zDOld7rA4VneT6r7i1irMLipQGpBEy1MEss_XpDOHSnalPxalqpcArH4LoQ5ISJh4SfaUOM Jul 05 13:12:00.715569 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Id: None Jul 05 13:12:00.715569 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Name: None Jul 05 13:12:00.715569 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Identity-Status: Confirmed Jul 05 13:12:00.715569 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Is-Admin-Project: True Jul 05 13:12:00.715569 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Id: default Jul 05 13:12:00.715569 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Name: Default Jul 05 13:12:00.715569 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Id: 277fa3c89dff47b88894b781ff69fb70 Jul 05 13:12:00.715569 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Name: tempest-TestVolumeBootPattern-848454944 Jul 05 13:12:00.715569 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Role: member,reader Jul 05 13:12:00.715569 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Roles: member,reader Jul 05 13:12:00.717266 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/277fa3c89dff47b88894b781ff69fb70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_277fa3c89dff47b88894b781ff69fb70", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/277fa3c89dff47b88894b781ff69fb70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/277fa3c89dff47b88894b781ff69fb70"}]}] Jul 05 13:12:00.717266 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant: tempest-TestVolumeBootPattern-848454944 Jul 05 13:12:00.717266 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Id: 277fa3c89dff47b88894b781ff69fb70 Jul 05 13:12:00.717266 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Name: tempest-TestVolumeBootPattern-848454944 Jul 05 13:12:00.717266 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User: tempest-TestVolumeBootPattern-848454944-project Jul 05 13:12:00.717266 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Id: default Jul 05 13:12:00.717266 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Name: Default Jul 05 13:12:00.717266 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Id: 661062780f5c45d180a05e402fc7bc27 Jul 05 13:12:00.717266 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Name: tempest-TestVolumeBootPattern-848454944-project Jul 05 13:12:00.717266 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: method: > Jul 05 13:12:00.717266 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: exception: Instance ba68561c-87aa-4ad8-a50c-de2cd1e938e2 could not be found. Jul 05 13:12:00.717266 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: action_args: {'id': 'ba68561c-87aa-4ad8-a50c-de2cd1e938e2'} Jul 05 13:12:00.718146 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 13:12:00.718146 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:12:00.718146 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 13:12:00.718146 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 13:12:00.718146 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 13:12:00.718146 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 13:12:00.718146 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 13:12:00.718146 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 13:12:00.718146 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 13:12:00.718146 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 13:12:00.718146 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba68561c-87aa-4ad8-a50c-de2cd1e938e2 could not be found. Jul 05 13:12:00.718146 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:12:00.718146 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:12:00.718146 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:12:00.718146 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:12:00.718146 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:12:00.718146 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:12:00.718146 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 13:12:00.718146 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 13:12:00.718146 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 13:12:00.719730 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 13:12:00.719730 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 13:12:00.719730 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 13:12:00.719730 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 13:12:00.719730 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 13:12:00.719730 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 13:12:00.719730 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 13:12:00.719730 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba68561c-87aa-4ad8-a50c-de2cd1e938e2 could not be found. Jul 05 13:12:00.719730 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:12:00.719730 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:12:00.719730 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:12:00.719730 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:12:00.719730 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:12:00.719730 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:12:00.719730 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 13:12:00.719730 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 13:12:00.719730 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba68561c-87aa-4ad8-a50c-de2cd1e938e2 could not be found. Jul 05 13:12:00.719730 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:12:00.723416 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-c1d5d0ed-396c-4a5b-8691-c839d7a61af5 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Returning 404 to user: Instance ba68561c-87aa-4ad8-a50c-de2cd1e938e2 could not be found. {{(pid=118387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 13:12:00.723416 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-c1d5d0ed-396c-4a5b-8691-c839d7a61af5 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "GET /compute/v2.1/servers/ba68561c-87aa-4ad8-a50c-de2cd1e938e2" status: 404 len: 111 microversion: 2.1 time: 0.035223 Jul 05 13:12:00.723416 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 568/1128] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:12:00 2022] GET /compute/v2.1/servers/ba68561c-87aa-4ad8-a50c-de2cd1e938e2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 13:12:02.278522 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-5ed6e98c-04b3-4de4-8d67-3ec4f8862ea0 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] Calling method '.version_select at 0x7f70de646d30>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:12:02.345465 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-5ed6e98c-04b3-4de4-8d67-3ec4f8862ea0 tempest-TestVolumeBootPattern-848454944 tempest-TestVolumeBootPattern-848454944-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1066638790" status: 202 len: 0 microversion: 2.1 time: 0.072076 Jul 05 13:12:02.345970 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 561/1129] 10.222.0.36 () {58 vars in 1262 bytes} [Tue Jul 5 13:12:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1066638790 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 13:12:03.404447 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-852468ce-9e87-4b42-8752-758e1a24bf88 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-770780059"}} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:12:03.405157 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-852468ce-9e87-4b42-8752-758e1a24bf88 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] [instance: b83da4e1-8af3-4959-905a-6f3be7e2cf19] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:12:03.411650 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-852468ce-9e87-4b42-8752-758e1a24bf88 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:03.412103 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-852468ce-9e87-4b42-8752-758e1a24bf88 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:03.413013 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-852468ce-9e87-4b42-8752-758e1a24bf88 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:03.413454 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-852468ce-9e87-4b42-8752-758e1a24bf88 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:03.661186 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.network.security_group_api [None req-852468ce-9e87-4b42-8752-758e1a24bf88 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Adding security group 1a7eaa52-97d0-496d-94e7-3cb0fd8c4d43 to port 6058ab7a-1269-4b24-bfb7-6b0f5686441f Jul 05 13:12:04.662104 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-852468ce-9e87-4b42-8752-758e1a24bf88 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] 10.222.0.36 "POST /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19/action" status: 202 len: 0 microversion: 2.1 time: 1.262165 Jul 05 13:12:04.667980 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 569/1130] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Jul 5 13:12:03 2022] POST /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19/action => generated 0 bytes in 1264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 13:12:04.677538 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-0f0cedcd-bcc0-4e62-abed-f501dc17add3 req-bc13046e-d2ca-4090-8a5b-bfdad2dea17e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b83da4e1-8af3-4959-905a-6f3be7e2cf19", "tag": "6058ab7a-1269-4b24-bfb7-6b0f5686441f"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:12:04.678684 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-46c650ba-f4ab-4863-8048-75ff3f4c77be tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:12:04.680919 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-46c650ba-f4ab-4863-8048-75ff3f4c77be tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] [instance: b83da4e1-8af3-4959-905a-6f3be7e2cf19] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:12:04.697407 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-46c650ba-f4ab-4863-8048-75ff3f4c77be tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:04.697860 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-46c650ba-f4ab-4863-8048-75ff3f4c77be tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:04.698684 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-46c650ba-f4ab-4863-8048-75ff3f4c77be tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:04.699113 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-46c650ba-f4ab-4863-8048-75ff3f4c77be tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:04.706540 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-0f0cedcd-bcc0-4e62-abed-f501dc17add3 req-bc13046e-d2ca-4090-8a5b-bfdad2dea17e service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:04.706540 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-0f0cedcd-bcc0-4e62-abed-f501dc17add3 req-bc13046e-d2ca-4090-8a5b-bfdad2dea17e service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:04.733076 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-0f0cedcd-bcc0-4e62-abed-f501dc17add3 req-bc13046e-d2ca-4090-8a5b-bfdad2dea17e service nova] Creating event network-changed:6058ab7a-1269-4b24-bfb7-6b0f5686441f for instance b83da4e1-8af3-4959-905a-6f3be7e2cf19 on hv-cinder-79760 Jul 05 13:12:04.740672 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-0f0cedcd-bcc0-4e62-abed-f501dc17add3 req-bc13046e-d2ca-4090-8a5b-bfdad2dea17e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066960 Jul 05 13:12:04.741273 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 570/1131] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:12:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:12:04.973518 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-46c650ba-f4ab-4863-8048-75ff3f4c77be tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8472b840794ab8ac0ccd49b2fd1657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0f29cb8f344bbf9fd1b7ffb626bbcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:12:04.983440 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-46c650ba-f4ab-4863-8048-75ff3f4c77be tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] 10.222.0.36 "GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19" status: 200 len: 1759 microversion: 2.1 time: 0.315980 Jul 05 13:12:04.984295 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 562/1132] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:12:04 2022] GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19 => generated 1759 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:12:05.895253 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-44899a01-d144-4d7a-8d77-5bfadf37967a tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:12:05.905079 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-44899a01-d144-4d7a-8d77-5bfadf37967a tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b41a4b2b-9dc1-4a39-add0-62f256d162d2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:12:05.905079 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-44899a01-d144-4d7a-8d77-5bfadf37967a tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:05.905079 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-44899a01-d144-4d7a-8d77-5bfadf37967a tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:05.905079 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-44899a01-d144-4d7a-8d77-5bfadf37967a tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:05.905532 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-44899a01-d144-4d7a-8d77-5bfadf37967a tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:05.935910 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-44899a01-d144-4d7a-8d77-5bfadf37967a tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b41a4b2b-9dc1-4a39-add0-62f256d162d2/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044931 Jul 05 13:12:05.939422 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 571/1133] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jul 5 13:12:05 2022] GET /compute/v2.1/servers/b41a4b2b-9dc1-4a39-add0-62f256d162d2/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:12:06.164471 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-ef127471-cdc6-4bec-83d8-abc76ec3e959 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:12:06.164975 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-ef127471-cdc6-4bec-83d8-abc76ec3e959 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b41a4b2b-9dc1-4a39-add0-62f256d162d2] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:12:06.171933 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ef127471-cdc6-4bec-83d8-abc76ec3e959 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:06.172381 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ef127471-cdc6-4bec-83d8-abc76ec3e959 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:06.173185 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ef127471-cdc6-4bec-83d8-abc76ec3e959 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:06.173620 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ef127471-cdc6-4bec-83d8-abc76ec3e959 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:06.201974 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-ef127471-cdc6-4bec-83d8-abc76ec3e959 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b41a4b2b-9dc1-4a39-add0-62f256d162d2/os-volume_attachments/ef89109e-351b-4914-8259-2203a37cd402" status: 200 len: 194 microversion: 2.1 time: 0.041453 Jul 05 13:12:06.202588 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 563/1134] 10.222.0.36 () {58 vars in 1412 bytes} [Tue Jul 5 13:12:06 2022] GET /compute/v2.1/servers/b41a4b2b-9dc1-4a39-add0-62f256d162d2/os-volume_attachments/ef89109e-351b-4914-8259-2203a37cd402 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:12:06.212180 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-7595bed4-8cba-434e-b8c8-c1f8c9b52cd9 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:12:06.212697 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-7595bed4-8cba-434e-b8c8-c1f8c9b52cd9 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b41a4b2b-9dc1-4a39-add0-62f256d162d2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:12:06.218586 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7595bed4-8cba-434e-b8c8-c1f8c9b52cd9 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:06.219035 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7595bed4-8cba-434e-b8c8-c1f8c9b52cd9 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:06.219787 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7595bed4-8cba-434e-b8c8-c1f8c9b52cd9 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:06.220223 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7595bed4-8cba-434e-b8c8-c1f8c9b52cd9 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:06.310893 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.objects.instance [None req-7595bed4-8cba-434e-b8c8-c1f8c9b52cd9 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lazy-loading 'services' on Instance uuid b41a4b2b-9dc1-4a39-add0-62f256d162d2 {{(pid=118387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 13:12:06.592205 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-7595bed4-8cba-434e-b8c8-c1f8c9b52cd9 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b41a4b2b-9dc1-4a39-add0-62f256d162d2/os-volume_attachments/ef89109e-351b-4914-8259-2203a37cd402" status: 202 len: 0 microversion: 2.1 time: 0.383755 Jul 05 13:12:06.593029 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 572/1135] 10.222.0.36 () {58 vars in 1415 bytes} [Tue Jul 5 13:12:06 2022] DELETE /compute/v2.1/servers/b41a4b2b-9dc1-4a39-add0-62f256d162d2/os-volume_attachments/ef89109e-351b-4914-8259-2203a37cd402 => generated 0 bytes in 385 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 13:12:08.766798 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-62be0e02-eceb-4a4b-ae73-a3ca615d4298 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:12:08.767393 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-62be0e02-eceb-4a4b-ae73-a3ca615d4298 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b41a4b2b-9dc1-4a39-add0-62f256d162d2] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:12:08.773879 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-62be0e02-eceb-4a4b-ae73-a3ca615d4298 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:08.774331 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-62be0e02-eceb-4a4b-ae73-a3ca615d4298 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:08.775094 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-62be0e02-eceb-4a4b-ae73-a3ca615d4298 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:08.775532 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-62be0e02-eceb-4a4b-ae73-a3ca615d4298 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:08.803854 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-62be0e02-eceb-4a4b-ae73-a3ca615d4298 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b41a4b2b-9dc1-4a39-add0-62f256d162d2/os-volume_attachments/3bfe2575-e592-4678-99e4-c191f51a348b" status: 200 len: 194 microversion: 2.1 time: 0.041502 Jul 05 13:12:08.804673 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 564/1136] 10.222.0.36 () {58 vars in 1412 bytes} [Tue Jul 5 13:12:08 2022] GET /compute/v2.1/servers/b41a4b2b-9dc1-4a39-add0-62f256d162d2/os-volume_attachments/3bfe2575-e592-4678-99e4-c191f51a348b => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:12:08.816539 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-fcd0a23e-1fcc-4976-87c8-9c860d4e67ec tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:12:08.822881 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-fcd0a23e-1fcc-4976-87c8-9c860d4e67ec tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b41a4b2b-9dc1-4a39-add0-62f256d162d2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:12:08.825002 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-fcd0a23e-1fcc-4976-87c8-9c860d4e67ec tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:08.825450 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-fcd0a23e-1fcc-4976-87c8-9c860d4e67ec tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:08.826502 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-fcd0a23e-1fcc-4976-87c8-9c860d4e67ec tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:08.826936 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-fcd0a23e-1fcc-4976-87c8-9c860d4e67ec tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:08.913579 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.objects.instance [None req-fcd0a23e-1fcc-4976-87c8-9c860d4e67ec tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lazy-loading 'services' on Instance uuid b41a4b2b-9dc1-4a39-add0-62f256d162d2 {{(pid=118387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 13:12:09.126968 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-fcd0a23e-1fcc-4976-87c8-9c860d4e67ec tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b41a4b2b-9dc1-4a39-add0-62f256d162d2/os-volume_attachments/3bfe2575-e592-4678-99e4-c191f51a348b" status: 202 len: 0 microversion: 2.1 time: 0.315689 Jul 05 13:12:09.127979 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 573/1137] 10.222.0.36 () {58 vars in 1415 bytes} [Tue Jul 5 13:12:08 2022] DELETE /compute/v2.1/servers/b41a4b2b-9dc1-4a39-add0-62f256d162d2/os-volume_attachments/3bfe2575-e592-4678-99e4-c191f51a348b => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 13:12:10.294196 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-41693218-e875-463c-8e2b-e4c4a4d4890c tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:12:10.301386 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-41693218-e875-463c-8e2b-e4c4a4d4890c tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b41a4b2b-9dc1-4a39-add0-62f256d162d2] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:12:10.302495 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-41693218-e875-463c-8e2b-e4c4a4d4890c tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:10.302894 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-41693218-e875-463c-8e2b-e4c4a4d4890c tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:10.303734 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-41693218-e875-463c-8e2b-e4c4a4d4890c tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:10.304237 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-41693218-e875-463c-8e2b-e4c4a4d4890c tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:10.335164 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-41693218-e875-463c-8e2b-e4c4a4d4890c tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b41a4b2b-9dc1-4a39-add0-62f256d162d2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046111 Jul 05 13:12:10.335654 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 565/1138] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jul 5 13:12:10 2022] GET /compute/v2.1/servers/b41a4b2b-9dc1-4a39-add0-62f256d162d2/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 05 13:12:10.468919 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-53dfd6ca-eedf-4343-8651-a6820137b7d5 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:12:10.472000 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-53dfd6ca-eedf-4343-8651-a6820137b7d5 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b41a4b2b-9dc1-4a39-add0-62f256d162d2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:12:10.476146 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-53dfd6ca-eedf-4343-8651-a6820137b7d5 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:10.476608 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-53dfd6ca-eedf-4343-8651-a6820137b7d5 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:10.477388 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-53dfd6ca-eedf-4343-8651-a6820137b7d5 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:10.477820 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-53dfd6ca-eedf-4343-8651-a6820137b7d5 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:10.504288 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=3 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:12:10.509615 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-53dfd6ca-eedf-4343-8651-a6820137b7d5 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b41a4b2b-9dc1-4a39-add0-62f256d162d2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046182 Jul 05 13:12:10.510327 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 574/1139] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jul 5 13:12:10 2022] GET /compute/v2.1/servers/b41a4b2b-9dc1-4a39-add0-62f256d162d2/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 05 13:12:10.575404 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-69d1bffe-fa28-41a4-bd53-2e6a0a087a8f tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:12:10.576467 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-69d1bffe-fa28-41a4-bd53-2e6a0a087a8f tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b41a4b2b-9dc1-4a39-add0-62f256d162d2] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:12:10.582258 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-69d1bffe-fa28-41a4-bd53-2e6a0a087a8f tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:10.582714 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-69d1bffe-fa28-41a4-bd53-2e6a0a087a8f tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:10.584267 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-69d1bffe-fa28-41a4-bd53-2e6a0a087a8f tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:10.584759 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-69d1bffe-fa28-41a4-bd53-2e6a0a087a8f tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:10.616544 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-69d1bffe-fa28-41a4-bd53-2e6a0a087a8f tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b41a4b2b-9dc1-4a39-add0-62f256d162d2] Going to try to terminate instance {{(pid=118386) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 13:12:10.892860 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-69d1bffe-fa28-41a4-bd53-2e6a0a087a8f tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b41a4b2b-9dc1-4a39-add0-62f256d162d2" status: 204 len: 0 microversion: 2.1 time: 0.322398 Jul 05 13:12:10.893526 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 566/1140] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jul 5 13:12:10 2022] DELETE /compute/v2.1/servers/b41a4b2b-9dc1-4a39-add0-62f256d162d2 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 05 13:12:10.902435 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-2f41803f-06e6-461d-912d-231d0b6696a8 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:12:10.903052 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-2f41803f-06e6-461d-912d-231d0b6696a8 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b41a4b2b-9dc1-4a39-add0-62f256d162d2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:12:10.909200 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2f41803f-06e6-461d-912d-231d0b6696a8 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:10.909651 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2f41803f-06e6-461d-912d-231d0b6696a8 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:10.910411 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2f41803f-06e6-461d-912d-231d0b6696a8 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:10.910841 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2f41803f-06e6-461d-912d-231d0b6696a8 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:11.040053 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-2f41803f-06e6-461d-912d-231d0b6696a8 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:12:11.047483 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-2f41803f-06e6-461d-912d-231d0b6696a8 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b41a4b2b-9dc1-4a39-add0-62f256d162d2" status: 200 len: 1672 microversion: 2.1 time: 0.149655 Jul 05 13:12:11.047982 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 575/1141] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:12:10 2022] GET /compute/v2.1/servers/b41a4b2b-9dc1-4a39-add0-62f256d162d2 => generated 1672 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:12:12.065205 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-ffeea8f3-0f7f-404f-a1d9-52b5b4792608 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:12:12.065940 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-ffeea8f3-0f7f-404f-a1d9-52b5b4792608 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b41a4b2b-9dc1-4a39-add0-62f256d162d2] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:12:12.072523 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ffeea8f3-0f7f-404f-a1d9-52b5b4792608 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:12.072993 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ffeea8f3-0f7f-404f-a1d9-52b5b4792608 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:12.073756 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ffeea8f3-0f7f-404f-a1d9-52b5b4792608 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:12.074690 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-ffeea8f3-0f7f-404f-a1d9-52b5b4792608 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:12.205437 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-ffeea8f3-0f7f-404f-a1d9-52b5b4792608 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:12:12.222010 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-ffeea8f3-0f7f-404f-a1d9-52b5b4792608 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b41a4b2b-9dc1-4a39-add0-62f256d162d2" status: 200 len: 1672 microversion: 2.1 time: 0.152670 Jul 05 13:12:12.222010 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 567/1142] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:12:12 2022] GET /compute/v2.1/servers/b41a4b2b-9dc1-4a39-add0-62f256d162d2 => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:12:13.231025 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-49b76541-82cf-42a4-8ab7-ae22a2b05f7c tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:12:13.231672 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-49b76541-82cf-42a4-8ab7-ae22a2b05f7c tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b41a4b2b-9dc1-4a39-add0-62f256d162d2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:12:13.242588 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-49b76541-82cf-42a4-8ab7-ae22a2b05f7c tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:13.243040 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-49b76541-82cf-42a4-8ab7-ae22a2b05f7c tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:13.243804 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-49b76541-82cf-42a4-8ab7-ae22a2b05f7c tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:13.244233 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-49b76541-82cf-42a4-8ab7-ae22a2b05f7c tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:13.378775 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-49b76541-82cf-42a4-8ab7-ae22a2b05f7c tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:12:13.388251 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-49b76541-82cf-42a4-8ab7-ae22a2b05f7c tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b41a4b2b-9dc1-4a39-add0-62f256d162d2" status: 200 len: 1672 microversion: 2.1 time: 0.161505 Jul 05 13:12:13.388845 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 576/1143] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:12:13 2022] GET /compute/v2.1/servers/b41a4b2b-9dc1-4a39-add0-62f256d162d2 => generated 1672 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:12:13.732518 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [req-b25bb7b6-0e97-47cd-82e5-0811529b77c6 req-bf23ec4d-d06a-4b69-bab3-7ce574be788e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b41a4b2b-9dc1-4a39-add0-62f256d162d2", "name": "network-vif-deleted", "tag": "7b5e2639-847f-4500-9b16-4a340a956382"}]} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:12:13.740980 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-b25bb7b6-0e97-47cd-82e5-0811529b77c6 req-bf23ec4d-d06a-4b69-bab3-7ce574be788e service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:13.741536 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-b25bb7b6-0e97-47cd-82e5-0811529b77c6 req-bf23ec4d-d06a-4b69-bab3-7ce574be788e service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:13.753921 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.compute.server_external_events [req-b25bb7b6-0e97-47cd-82e5-0811529b77c6 req-bf23ec4d-d06a-4b69-bab3-7ce574be788e service nova] Creating event network-vif-deleted:7b5e2639-847f-4500-9b16-4a340a956382 for instance b41a4b2b-9dc1-4a39-add0-62f256d162d2 on hv-cinder-79760 Jul 05 13:12:13.758921 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [req-b25bb7b6-0e97-47cd-82e5-0811529b77c6 req-bf23ec4d-d06a-4b69-bab3-7ce574be788e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030965 Jul 05 13:12:13.759833 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 568/1144] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:12:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:12:14.406065 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-b206c3c7-de44-471f-a400-828f20780644 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:12:14.406961 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-b206c3c7-de44-471f-a400-828f20780644 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b41a4b2b-9dc1-4a39-add0-62f256d162d2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:12:14.413932 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b206c3c7-de44-471f-a400-828f20780644 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:14.414386 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b206c3c7-de44-471f-a400-828f20780644 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:14.415161 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b206c3c7-de44-471f-a400-828f20780644 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:14.415607 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b206c3c7-de44-471f-a400-828f20780644 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:14.446218 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b206c3c7-de44-471f-a400-828f20780644 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:14.446674 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b206c3c7-de44-471f-a400-828f20780644 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:14.447171 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.objects.instance [None req-b206c3c7-de44-471f-a400-828f20780644 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lazy-loading 'fault' on Instance uuid b41a4b2b-9dc1-4a39-add0-62f256d162d2 {{(pid=118387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 13:12:14.490199 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-b206c3c7-de44-471f-a400-828f20780644 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ce49dfe7d0401caa1784c35b2ef90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9afdc843646768800da2ede466298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:12:14.498695 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-b206c3c7-de44-471f-a400-828f20780644 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b41a4b2b-9dc1-4a39-add0-62f256d162d2" status: 200 len: 1328 microversion: 2.1 time: 0.097404 Jul 05 13:12:14.499364 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 577/1145] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:12:14 2022] GET /compute/v2.1/servers/b41a4b2b-9dc1-4a39-add0-62f256d162d2 => generated 1328 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:12:15.517526 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-5d6f9e78-82e6-4f37-8840-71257eaef1a2 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:12:15.518170 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-5d6f9e78-82e6-4f37-8840-71257eaef1a2 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b41a4b2b-9dc1-4a39-add0-62f256d162d2] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:12:15.524361 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-5d6f9e78-82e6-4f37-8840-71257eaef1a2 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:15.524837 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-5d6f9e78-82e6-4f37-8840-71257eaef1a2 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:15.525595 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-5d6f9e78-82e6-4f37-8840-71257eaef1a2 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:15.526029 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-5d6f9e78-82e6-4f37-8840-71257eaef1a2 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:15.539350 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.wsgi [None req-5d6f9e78-82e6-4f37-8840-71257eaef1a2 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] HTTP exception thrown: Instance b41a4b2b-9dc1-4a39-add0-62f256d162d2 could not be found. Jul 05 13:12:15.540957 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-5d6f9e78-82e6-4f37-8840-71257eaef1a2 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Request method failure captured: Jul 05 13:12:15.540957 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: request: GET /compute/v2.1/servers/b41a4b2b-9dc1-4a39-add0-62f256d162d2 HTTP/1.1 Jul 05 13:12:15.540957 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Accept: application/json Jul 05 13:12:15.540957 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Accept-Encoding: identity Jul 05 13:12:15.540957 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Connection: close Jul 05 13:12:15.540957 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Content-Length: 0 Jul 05 13:12:15.540957 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Content-Type: application/json Jul 05 13:12:15.540957 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Host: 10.222.0.36 Jul 05 13:12:15.540957 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Openstack-System-Scope: None Jul 05 13:12:15.540957 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: User-Agent: python-urllib3/1.26.9 Jul 05 13:12:15.540957 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Auth-Token: gAAAAABixDd1eMnIl92b8_XGVczMchFuYVHQG_nrQ4hRQYU85ROtXKC6Dj8_un1UBiICko2roRRfLzLCRXveyKdGJJuBasj7tIj06-JO2_Sox3e8sjV--z7ur9pmCZXisSQSHO0VgqYAAKUg2lmCgW4T4-xF4YQzceHZP8rmU_ITZqDjzTPDUKM Jul 05 13:12:15.540957 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Domain-Id: None Jul 05 13:12:15.540957 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Domain-Name: None Jul 05 13:12:15.540957 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Identity-Status: Confirmed Jul 05 13:12:15.540957 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Is-Admin-Project: True Jul 05 13:12:15.540957 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Domain-Id: default Jul 05 13:12:15.540957 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Domain-Name: Default Jul 05 13:12:15.540957 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Id: a9e9afdc843646768800da2ede466298 Jul 05 13:12:15.540957 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Name: tempest-AttachVolumeTestJSON-475672718 Jul 05 13:12:15.540957 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Role: member,reader Jul 05 13:12:15.540957 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Roles: member,reader Jul 05 13:12:15.542667 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a9e9afdc843646768800da2ede466298"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a9e9afdc843646768800da2ede466298", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a9e9afdc843646768800da2ede466298"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a9e9afdc843646768800da2ede466298"}]}] Jul 05 13:12:15.542667 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Tenant: tempest-AttachVolumeTestJSON-475672718 Jul 05 13:12:15.542667 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Tenant-Id: a9e9afdc843646768800da2ede466298 Jul 05 13:12:15.542667 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Tenant-Name: tempest-AttachVolumeTestJSON-475672718 Jul 05 13:12:15.542667 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User: tempest-AttachVolumeTestJSON-475672718-project Jul 05 13:12:15.542667 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Domain-Id: default Jul 05 13:12:15.542667 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Domain-Name: Default Jul 05 13:12:15.542667 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Id: 15ce49dfe7d0401caa1784c35b2ef90e Jul 05 13:12:15.542667 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Name: tempest-AttachVolumeTestJSON-475672718-project Jul 05 13:12:15.542667 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: method: > Jul 05 13:12:15.542667 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: exception: Instance b41a4b2b-9dc1-4a39-add0-62f256d162d2 could not be found. Jul 05 13:12:15.542667 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: action_args: {'id': 'b41a4b2b-9dc1-4a39-add0-62f256d162d2'} Jul 05 13:12:15.544226 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 13:12:15.544226 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:12:15.544226 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 13:12:15.544226 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 13:12:15.544226 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 13:12:15.544226 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 13:12:15.544226 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 13:12:15.544226 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 13:12:15.544226 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 13:12:15.544226 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 13:12:15.544226 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b41a4b2b-9dc1-4a39-add0-62f256d162d2 could not be found. Jul 05 13:12:15.544226 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:12:15.544226 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:12:15.544226 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:12:15.544226 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:12:15.544226 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:12:15.544226 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:12:15.544226 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 13:12:15.544226 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 13:12:15.544226 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 13:12:15.545861 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 13:12:15.545861 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 13:12:15.545861 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 13:12:15.545861 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 13:12:15.545861 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 13:12:15.545861 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 13:12:15.545861 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 13:12:15.545861 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b41a4b2b-9dc1-4a39-add0-62f256d162d2 could not be found. Jul 05 13:12:15.545861 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:12:15.545861 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:12:15.545861 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:12:15.545861 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:12:15.545861 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:12:15.545861 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:12:15.545861 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 13:12:15.545861 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 13:12:15.545861 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b41a4b2b-9dc1-4a39-add0-62f256d162d2 could not be found. Jul 05 13:12:15.545861 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:12:15.547283 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-5d6f9e78-82e6-4f37-8840-71257eaef1a2 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Returning 404 to user: Instance b41a4b2b-9dc1-4a39-add0-62f256d162d2 could not be found. {{(pid=118386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 13:12:15.547283 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-5d6f9e78-82e6-4f37-8840-71257eaef1a2 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b41a4b2b-9dc1-4a39-add0-62f256d162d2" status: 404 len: 111 microversion: 2.1 time: 0.029628 Jul 05 13:12:15.547283 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 569/1146] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:12:15 2022] GET /compute/v2.1/servers/b41a4b2b-9dc1-4a39-add0-62f256d162d2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 13:12:15.551559 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-58b76ac6-8413-4520-9fca-114dd86cd817 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '.version_select at 0x7f70de78d700>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:12:15.681858 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-58b76ac6-8413-4520-9fca-114dd86cd817 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1471489962" status: 202 len: 0 microversion: 2.1 time: 0.133986 Jul 05 13:12:15.682441 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 578/1147] 10.222.0.36 () {58 vars in 1220 bytes} [Tue Jul 5 13:12:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1471489962 => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 13:12:19.213504 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-31922c5d-8a19-4ee1-886f-fb5c59b9abbd tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:12:19.214001 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-31922c5d-8a19-4ee1-886f-fb5c59b9abbd tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b41a4b2b-9dc1-4a39-add0-62f256d162d2] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:12:19.221149 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-31922c5d-8a19-4ee1-886f-fb5c59b9abbd tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:19.221621 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-31922c5d-8a19-4ee1-886f-fb5c59b9abbd tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:19.222376 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-31922c5d-8a19-4ee1-886f-fb5c59b9abbd tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:19.222826 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-31922c5d-8a19-4ee1-886f-fb5c59b9abbd tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:19.236823 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.wsgi [None req-31922c5d-8a19-4ee1-886f-fb5c59b9abbd tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] HTTP exception thrown: Instance b41a4b2b-9dc1-4a39-add0-62f256d162d2 could not be found. Jul 05 13:12:19.238363 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-31922c5d-8a19-4ee1-886f-fb5c59b9abbd tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Request method failure captured: Jul 05 13:12:19.238363 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: request: DELETE /compute/v2.1/servers/b41a4b2b-9dc1-4a39-add0-62f256d162d2 HTTP/1.1 Jul 05 13:12:19.238363 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Accept: application/json Jul 05 13:12:19.238363 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Accept-Encoding: identity Jul 05 13:12:19.238363 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Connection: close Jul 05 13:12:19.238363 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Content-Length: 0 Jul 05 13:12:19.238363 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Content-Type: application/json Jul 05 13:12:19.238363 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Host: 10.222.0.36 Jul 05 13:12:19.238363 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Openstack-System-Scope: None Jul 05 13:12:19.238363 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: User-Agent: python-urllib3/1.26.9 Jul 05 13:12:19.238363 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Auth-Token: gAAAAABixDd1eMnIl92b8_XGVczMchFuYVHQG_nrQ4hRQYU85ROtXKC6Dj8_un1UBiICko2roRRfLzLCRXveyKdGJJuBasj7tIj06-JO2_Sox3e8sjV--z7ur9pmCZXisSQSHO0VgqYAAKUg2lmCgW4T4-xF4YQzceHZP8rmU_ITZqDjzTPDUKM Jul 05 13:12:19.238363 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Domain-Id: None Jul 05 13:12:19.238363 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Domain-Name: None Jul 05 13:12:19.238363 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Identity-Status: Confirmed Jul 05 13:12:19.238363 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Is-Admin-Project: True Jul 05 13:12:19.238363 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Domain-Id: default Jul 05 13:12:19.238363 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Domain-Name: Default Jul 05 13:12:19.238363 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Id: a9e9afdc843646768800da2ede466298 Jul 05 13:12:19.238363 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Name: tempest-AttachVolumeTestJSON-475672718 Jul 05 13:12:19.238363 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Role: member,reader Jul 05 13:12:19.238363 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Roles: member,reader Jul 05 13:12:19.239889 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a9e9afdc843646768800da2ede466298"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a9e9afdc843646768800da2ede466298", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a9e9afdc843646768800da2ede466298"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a9e9afdc843646768800da2ede466298"}]}] Jul 05 13:12:19.239889 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Tenant: tempest-AttachVolumeTestJSON-475672718 Jul 05 13:12:19.239889 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Tenant-Id: a9e9afdc843646768800da2ede466298 Jul 05 13:12:19.239889 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Tenant-Name: tempest-AttachVolumeTestJSON-475672718 Jul 05 13:12:19.239889 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User: tempest-AttachVolumeTestJSON-475672718-project Jul 05 13:12:19.239889 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Domain-Id: default Jul 05 13:12:19.239889 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Domain-Name: Default Jul 05 13:12:19.239889 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Id: 15ce49dfe7d0401caa1784c35b2ef90e Jul 05 13:12:19.239889 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Name: tempest-AttachVolumeTestJSON-475672718-project Jul 05 13:12:19.239889 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: method: > Jul 05 13:12:19.239889 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: exception: Instance b41a4b2b-9dc1-4a39-add0-62f256d162d2 could not be found. Jul 05 13:12:19.239889 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: action_args: {'id': 'b41a4b2b-9dc1-4a39-add0-62f256d162d2'} Jul 05 13:12:19.241480 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 13:12:19.241480 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:12:19.241480 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 13:12:19.241480 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 13:12:19.241480 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 13:12:19.241480 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 13:12:19.241480 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 13:12:19.241480 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 13:12:19.241480 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 13:12:19.241480 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 13:12:19.241480 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b41a4b2b-9dc1-4a39-add0-62f256d162d2 could not be found. Jul 05 13:12:19.241480 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:12:19.241480 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:12:19.241480 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:12:19.241480 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:12:19.241480 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:12:19.241480 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:12:19.241480 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 13:12:19.241480 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 13:12:19.241480 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 13:12:19.243001 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 13:12:19.243001 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 05 13:12:19.243001 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 05 13:12:19.243001 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 05 13:12:19.243001 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 05 13:12:19.243001 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 13:12:19.243001 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 13:12:19.243001 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 13:12:19.243001 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 13:12:19.243001 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b41a4b2b-9dc1-4a39-add0-62f256d162d2 could not be found. Jul 05 13:12:19.243001 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:12:19.243001 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:12:19.243001 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:12:19.243001 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:12:19.243001 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:12:19.243001 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:12:19.243001 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 13:12:19.243001 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 13:12:19.243001 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b41a4b2b-9dc1-4a39-add0-62f256d162d2 could not be found. Jul 05 13:12:19.243001 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:12:19.244521 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-31922c5d-8a19-4ee1-886f-fb5c59b9abbd tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Returning 404 to user: Instance b41a4b2b-9dc1-4a39-add0-62f256d162d2 could not be found. {{(pid=118386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 13:12:19.244521 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-31922c5d-8a19-4ee1-886f-fb5c59b9abbd tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b41a4b2b-9dc1-4a39-add0-62f256d162d2" status: 404 len: 111 microversion: 2.1 time: 0.030072 Jul 05 13:12:19.244521 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 570/1148] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jul 5 13:12:19 2022] DELETE /compute/v2.1/servers/b41a4b2b-9dc1-4a39-add0-62f256d162d2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 13:12:19.248807 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-df244d33-4865-4186-9ef4-477de47db21a tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:12:19.249425 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-df244d33-4865-4186-9ef4-477de47db21a tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b41a4b2b-9dc1-4a39-add0-62f256d162d2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:12:19.255329 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-df244d33-4865-4186-9ef4-477de47db21a tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:19.255778 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-df244d33-4865-4186-9ef4-477de47db21a tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:19.256528 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-df244d33-4865-4186-9ef4-477de47db21a tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:19.256986 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-df244d33-4865-4186-9ef4-477de47db21a tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:19.271756 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.wsgi [None req-df244d33-4865-4186-9ef4-477de47db21a tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] HTTP exception thrown: Instance b41a4b2b-9dc1-4a39-add0-62f256d162d2 could not be found. Jul 05 13:12:19.275009 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-df244d33-4865-4186-9ef4-477de47db21a tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Request method failure captured: Jul 05 13:12:19.275009 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: request: GET /compute/v2.1/servers/b41a4b2b-9dc1-4a39-add0-62f256d162d2 HTTP/1.1 Jul 05 13:12:19.275009 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept: application/json Jul 05 13:12:19.275009 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept-Encoding: identity Jul 05 13:12:19.275009 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Connection: close Jul 05 13:12:19.275009 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Length: 0 Jul 05 13:12:19.275009 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Type: application/json Jul 05 13:12:19.275009 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Host: 10.222.0.36 Jul 05 13:12:19.275009 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Openstack-System-Scope: None Jul 05 13:12:19.275009 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: User-Agent: python-urllib3/1.26.9 Jul 05 13:12:19.275009 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Auth-Token: gAAAAABixDd1eMnIl92b8_XGVczMchFuYVHQG_nrQ4hRQYU85ROtXKC6Dj8_un1UBiICko2roRRfLzLCRXveyKdGJJuBasj7tIj06-JO2_Sox3e8sjV--z7ur9pmCZXisSQSHO0VgqYAAKUg2lmCgW4T4-xF4YQzceHZP8rmU_ITZqDjzTPDUKM Jul 05 13:12:19.275009 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Id: None Jul 05 13:12:19.275009 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Name: None Jul 05 13:12:19.275009 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Identity-Status: Confirmed Jul 05 13:12:19.275009 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Is-Admin-Project: True Jul 05 13:12:19.275009 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Id: default Jul 05 13:12:19.275009 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Name: Default Jul 05 13:12:19.275009 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Id: a9e9afdc843646768800da2ede466298 Jul 05 13:12:19.275009 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Name: tempest-AttachVolumeTestJSON-475672718 Jul 05 13:12:19.275009 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Role: member,reader Jul 05 13:12:19.275009 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Roles: member,reader Jul 05 13:12:19.276692 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a9e9afdc843646768800da2ede466298"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a9e9afdc843646768800da2ede466298", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a9e9afdc843646768800da2ede466298"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a9e9afdc843646768800da2ede466298"}]}] Jul 05 13:12:19.276692 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant: tempest-AttachVolumeTestJSON-475672718 Jul 05 13:12:19.276692 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Id: a9e9afdc843646768800da2ede466298 Jul 05 13:12:19.276692 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Name: tempest-AttachVolumeTestJSON-475672718 Jul 05 13:12:19.276692 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User: tempest-AttachVolumeTestJSON-475672718-project Jul 05 13:12:19.276692 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Id: default Jul 05 13:12:19.276692 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Name: Default Jul 05 13:12:19.276692 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Id: 15ce49dfe7d0401caa1784c35b2ef90e Jul 05 13:12:19.276692 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Name: tempest-AttachVolumeTestJSON-475672718-project Jul 05 13:12:19.276692 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: method: > Jul 05 13:12:19.276692 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: exception: Instance b41a4b2b-9dc1-4a39-add0-62f256d162d2 could not be found. Jul 05 13:12:19.276692 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: action_args: {'id': 'b41a4b2b-9dc1-4a39-add0-62f256d162d2'} Jul 05 13:12:19.278342 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 13:12:19.278342 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:12:19.278342 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 13:12:19.278342 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 13:12:19.278342 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 13:12:19.278342 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 13:12:19.278342 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 13:12:19.278342 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 13:12:19.278342 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 13:12:19.278342 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 13:12:19.278342 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b41a4b2b-9dc1-4a39-add0-62f256d162d2 could not be found. Jul 05 13:12:19.278342 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:12:19.278342 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:12:19.278342 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:12:19.278342 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:12:19.278342 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:12:19.278342 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:12:19.278342 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 13:12:19.278342 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 13:12:19.278342 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 13:12:19.279946 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 13:12:19.279946 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 13:12:19.279946 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 13:12:19.279946 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 13:12:19.279946 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 13:12:19.279946 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 13:12:19.279946 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 13:12:19.279946 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b41a4b2b-9dc1-4a39-add0-62f256d162d2 could not be found. Jul 05 13:12:19.279946 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:12:19.279946 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:12:19.279946 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:12:19.279946 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:12:19.279946 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:12:19.279946 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:12:19.279946 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 13:12:19.279946 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 13:12:19.279946 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b41a4b2b-9dc1-4a39-add0-62f256d162d2 could not be found. Jul 05 13:12:19.279946 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:12:19.281335 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-df244d33-4865-4186-9ef4-477de47db21a tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Returning 404 to user: Instance b41a4b2b-9dc1-4a39-add0-62f256d162d2 could not be found. {{(pid=118387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 13:12:19.281335 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-df244d33-4865-4186-9ef4-477de47db21a tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b41a4b2b-9dc1-4a39-add0-62f256d162d2" status: 404 len: 111 microversion: 2.1 time: 0.032913 Jul 05 13:12:19.281335 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 579/1149] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:12:19 2022] GET /compute/v2.1/servers/b41a4b2b-9dc1-4a39-add0-62f256d162d2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 13:12:20.572315 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-4fa74af7-67dd-486d-95e4-a791eabfe7a3 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:12:20.572825 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-4fa74af7-67dd-486d-95e4-a791eabfe7a3 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:12:20.579208 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-4fa74af7-67dd-486d-95e4-a791eabfe7a3 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:20.579657 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-4fa74af7-67dd-486d-95e4-a791eabfe7a3 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:20.580403 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-4fa74af7-67dd-486d-95e4-a791eabfe7a3 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:20.580857 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-4fa74af7-67dd-486d-95e4-a791eabfe7a3 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:20.583473 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:12:20.595307 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.wsgi [None req-4fa74af7-67dd-486d-95e4-a791eabfe7a3 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] HTTP exception thrown: Instance b55ca313-2e09-4b58-b7e7-cdda74ffdd25 could not be found. Jul 05 13:12:20.596857 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-4fa74af7-67dd-486d-95e4-a791eabfe7a3 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Request method failure captured: Jul 05 13:12:20.596857 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: request: DELETE /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 HTTP/1.1 Jul 05 13:12:20.596857 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Accept: application/json Jul 05 13:12:20.596857 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Accept-Encoding: identity Jul 05 13:12:20.596857 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Connection: close Jul 05 13:12:20.596857 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Content-Length: 0 Jul 05 13:12:20.596857 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Content-Type: application/json Jul 05 13:12:20.596857 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Host: 10.222.0.36 Jul 05 13:12:20.596857 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Openstack-System-Scope: None Jul 05 13:12:20.596857 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: User-Agent: python-urllib3/1.26.9 Jul 05 13:12:20.596857 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Auth-Token: gAAAAABixDd1eMnIl92b8_XGVczMchFuYVHQG_nrQ4hRQYU85ROtXKC6Dj8_un1UBiICko2roRRfLzLCRXveyKdGJJuBasj7tIj06-JO2_Sox3e8sjV--z7ur9pmCZXisSQSHO0VgqYAAKUg2lmCgW4T4-xF4YQzceHZP8rmU_ITZqDjzTPDUKM Jul 05 13:12:20.596857 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Domain-Id: None Jul 05 13:12:20.596857 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Domain-Name: None Jul 05 13:12:20.596857 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Identity-Status: Confirmed Jul 05 13:12:20.596857 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Is-Admin-Project: True Jul 05 13:12:20.596857 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Domain-Id: default Jul 05 13:12:20.596857 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Domain-Name: Default Jul 05 13:12:20.596857 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Id: a9e9afdc843646768800da2ede466298 Jul 05 13:12:20.596857 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Name: tempest-AttachVolumeTestJSON-475672718 Jul 05 13:12:20.596857 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Role: member,reader Jul 05 13:12:20.596857 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Roles: member,reader Jul 05 13:12:20.598638 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a9e9afdc843646768800da2ede466298"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a9e9afdc843646768800da2ede466298", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a9e9afdc843646768800da2ede466298"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a9e9afdc843646768800da2ede466298"}]}] Jul 05 13:12:20.598638 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Tenant: tempest-AttachVolumeTestJSON-475672718 Jul 05 13:12:20.598638 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Tenant-Id: a9e9afdc843646768800da2ede466298 Jul 05 13:12:20.598638 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Tenant-Name: tempest-AttachVolumeTestJSON-475672718 Jul 05 13:12:20.598638 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User: tempest-AttachVolumeTestJSON-475672718-project Jul 05 13:12:20.598638 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Domain-Id: default Jul 05 13:12:20.598638 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Domain-Name: Default Jul 05 13:12:20.598638 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Id: 15ce49dfe7d0401caa1784c35b2ef90e Jul 05 13:12:20.598638 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Name: tempest-AttachVolumeTestJSON-475672718-project Jul 05 13:12:20.598638 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: method: > Jul 05 13:12:20.598638 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: exception: Instance b55ca313-2e09-4b58-b7e7-cdda74ffdd25 could not be found. Jul 05 13:12:20.598638 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: action_args: {'id': 'b55ca313-2e09-4b58-b7e7-cdda74ffdd25'} Jul 05 13:12:20.599568 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 13:12:20.599568 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:12:20.599568 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 13:12:20.599568 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 13:12:20.599568 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 13:12:20.599568 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 13:12:20.599568 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 13:12:20.599568 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 13:12:20.599568 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 13:12:20.599568 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 13:12:20.599568 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b55ca313-2e09-4b58-b7e7-cdda74ffdd25 could not be found. Jul 05 13:12:20.599568 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:12:20.599568 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:12:20.599568 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:12:20.599568 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:12:20.599568 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:12:20.599568 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:12:20.599568 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 13:12:20.599568 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 13:12:20.599568 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 13:12:20.604738 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 13:12:20.604738 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 05 13:12:20.604738 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 05 13:12:20.604738 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 05 13:12:20.604738 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 05 13:12:20.604738 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 13:12:20.604738 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 13:12:20.604738 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 13:12:20.604738 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 13:12:20.604738 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b55ca313-2e09-4b58-b7e7-cdda74ffdd25 could not be found. Jul 05 13:12:20.604738 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:12:20.604738 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:12:20.604738 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:12:20.604738 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:12:20.604738 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:12:20.604738 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:12:20.604738 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 13:12:20.604738 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 13:12:20.604738 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b55ca313-2e09-4b58-b7e7-cdda74ffdd25 could not be found. Jul 05 13:12:20.604738 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:12:20.607092 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-4fa74af7-67dd-486d-95e4-a791eabfe7a3 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Returning 404 to user: Instance b55ca313-2e09-4b58-b7e7-cdda74ffdd25 could not be found. {{(pid=118386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 13:12:20.607092 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-4fa74af7-67dd-486d-95e4-a791eabfe7a3 tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25" status: 404 len: 111 microversion: 2.1 time: 0.029726 Jul 05 13:12:20.607092 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 571/1150] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jul 5 13:12:20 2022] DELETE /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 05 13:12:20.611786 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-781cde57-37a0-4b6a-8a44-da1e2c797b3d tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:12:20.612397 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-781cde57-37a0-4b6a-8a44-da1e2c797b3d tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] [instance: b55ca313-2e09-4b58-b7e7-cdda74ffdd25] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:12:20.618922 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-781cde57-37a0-4b6a-8a44-da1e2c797b3d tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:20.619365 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-781cde57-37a0-4b6a-8a44-da1e2c797b3d tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:20.620119 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-781cde57-37a0-4b6a-8a44-da1e2c797b3d tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:20.620550 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-781cde57-37a0-4b6a-8a44-da1e2c797b3d tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:20.633672 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.wsgi [None req-781cde57-37a0-4b6a-8a44-da1e2c797b3d tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] HTTP exception thrown: Instance b55ca313-2e09-4b58-b7e7-cdda74ffdd25 could not be found. Jul 05 13:12:20.635108 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-781cde57-37a0-4b6a-8a44-da1e2c797b3d tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Request method failure captured: Jul 05 13:12:20.635108 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: request: GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 HTTP/1.1 Jul 05 13:12:20.635108 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept: application/json Jul 05 13:12:20.635108 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept-Encoding: identity Jul 05 13:12:20.635108 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Connection: close Jul 05 13:12:20.635108 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Length: 0 Jul 05 13:12:20.635108 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Type: application/json Jul 05 13:12:20.635108 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Host: 10.222.0.36 Jul 05 13:12:20.635108 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Openstack-System-Scope: None Jul 05 13:12:20.635108 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: User-Agent: python-urllib3/1.26.9 Jul 05 13:12:20.635108 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Auth-Token: gAAAAABixDd1eMnIl92b8_XGVczMchFuYVHQG_nrQ4hRQYU85ROtXKC6Dj8_un1UBiICko2roRRfLzLCRXveyKdGJJuBasj7tIj06-JO2_Sox3e8sjV--z7ur9pmCZXisSQSHO0VgqYAAKUg2lmCgW4T4-xF4YQzceHZP8rmU_ITZqDjzTPDUKM Jul 05 13:12:20.635108 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Id: None Jul 05 13:12:20.635108 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Name: None Jul 05 13:12:20.635108 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Identity-Status: Confirmed Jul 05 13:12:20.635108 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Is-Admin-Project: True Jul 05 13:12:20.635108 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Id: default Jul 05 13:12:20.635108 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Name: Default Jul 05 13:12:20.635108 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Id: a9e9afdc843646768800da2ede466298 Jul 05 13:12:20.635108 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Name: tempest-AttachVolumeTestJSON-475672718 Jul 05 13:12:20.635108 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Role: member,reader Jul 05 13:12:20.635108 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Roles: member,reader Jul 05 13:12:20.636989 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a9e9afdc843646768800da2ede466298"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a9e9afdc843646768800da2ede466298", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a9e9afdc843646768800da2ede466298"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a9e9afdc843646768800da2ede466298"}]}] Jul 05 13:12:20.636989 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant: tempest-AttachVolumeTestJSON-475672718 Jul 05 13:12:20.636989 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Id: a9e9afdc843646768800da2ede466298 Jul 05 13:12:20.636989 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Name: tempest-AttachVolumeTestJSON-475672718 Jul 05 13:12:20.636989 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User: tempest-AttachVolumeTestJSON-475672718-project Jul 05 13:12:20.636989 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Id: default Jul 05 13:12:20.636989 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Name: Default Jul 05 13:12:20.636989 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Id: 15ce49dfe7d0401caa1784c35b2ef90e Jul 05 13:12:20.636989 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Name: tempest-AttachVolumeTestJSON-475672718-project Jul 05 13:12:20.636989 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: method: > Jul 05 13:12:20.636989 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: exception: Instance b55ca313-2e09-4b58-b7e7-cdda74ffdd25 could not be found. Jul 05 13:12:20.636989 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: action_args: {'id': 'b55ca313-2e09-4b58-b7e7-cdda74ffdd25'} Jul 05 13:12:20.638020 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 13:12:20.638020 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:12:20.638020 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 13:12:20.638020 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 13:12:20.638020 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 13:12:20.638020 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 13:12:20.638020 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 13:12:20.638020 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 13:12:20.638020 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 13:12:20.638020 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 13:12:20.638020 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b55ca313-2e09-4b58-b7e7-cdda74ffdd25 could not be found. Jul 05 13:12:20.638020 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:12:20.638020 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:12:20.638020 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:12:20.638020 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:12:20.638020 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:12:20.638020 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:12:20.638020 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 13:12:20.638020 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 13:12:20.638020 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 13:12:20.639543 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 13:12:20.639543 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 13:12:20.639543 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 13:12:20.639543 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 13:12:20.639543 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 13:12:20.639543 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 13:12:20.639543 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 13:12:20.639543 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b55ca313-2e09-4b58-b7e7-cdda74ffdd25 could not be found. Jul 05 13:12:20.639543 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:12:20.639543 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:12:20.639543 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:12:20.639543 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:12:20.639543 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:12:20.639543 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:12:20.639543 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 13:12:20.639543 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 13:12:20.639543 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b55ca313-2e09-4b58-b7e7-cdda74ffdd25 could not be found. Jul 05 13:12:20.639543 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:12:20.641087 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-781cde57-37a0-4b6a-8a44-da1e2c797b3d tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] Returning 404 to user: Instance b55ca313-2e09-4b58-b7e7-cdda74ffdd25 could not be found. {{(pid=118387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 13:12:20.641087 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-781cde57-37a0-4b6a-8a44-da1e2c797b3d tempest-AttachVolumeTestJSON-475672718 tempest-AttachVolumeTestJSON-475672718-project] 10.222.0.36 "GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25" status: 404 len: 111 microversion: 2.1 time: 0.028500 Jul 05 13:12:20.641087 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 580/1151] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:12:20 2022] GET /compute/v2.1/servers/b55ca313-2e09-4b58-b7e7-cdda74ffdd25 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 13:12:26.687622 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-8f8e98fb-11d8-4007-8c80-d1729b58caa3 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:12:26.688494 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-8f8e98fb-11d8-4007-8c80-d1729b58caa3 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] [instance: b83da4e1-8af3-4959-905a-6f3be7e2cf19] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:12:26.696956 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-8f8e98fb-11d8-4007-8c80-d1729b58caa3 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:26.697294 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-8f8e98fb-11d8-4007-8c80-d1729b58caa3 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:26.698126 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-8f8e98fb-11d8-4007-8c80-d1729b58caa3 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:26.698552 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-8f8e98fb-11d8-4007-8c80-d1729b58caa3 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:27.000376 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-8f8e98fb-11d8-4007-8c80-d1729b58caa3 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] 10.222.0.36 "POST /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19/action" status: 202 len: 0 microversion: 2.1 time: 0.316459 Jul 05 13:12:27.000986 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 572/1152] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Jul 5 13:12:26 2022] POST /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19/action => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 13:12:27.010173 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-60c14eb2-c45b-4020-a11b-3f3e7f1c2f11 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:12:27.010816 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-60c14eb2-c45b-4020-a11b-3f3e7f1c2f11 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] [instance: b83da4e1-8af3-4959-905a-6f3be7e2cf19] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:12:27.013730 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:12:27.018933 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-60c14eb2-c45b-4020-a11b-3f3e7f1c2f11 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:27.019395 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-60c14eb2-c45b-4020-a11b-3f3e7f1c2f11 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:27.020209 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-60c14eb2-c45b-4020-a11b-3f3e7f1c2f11 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:27.020638 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-60c14eb2-c45b-4020-a11b-3f3e7f1c2f11 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:27.162844 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-60c14eb2-c45b-4020-a11b-3f3e7f1c2f11 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8472b840794ab8ac0ccd49b2fd1657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0f29cb8f344bbf9fd1b7ffb626bbcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:12:27.170964 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-60c14eb2-c45b-4020-a11b-3f3e7f1c2f11 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] 10.222.0.36 "GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19" status: 200 len: 1751 microversion: 2.1 time: 0.165600 Jul 05 13:12:27.171723 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 581/1153] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:12:27 2022] GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19 => generated 1751 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:12:27.566578 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-62235120-9f86-4861-8ae9-5d3cc689d927 tempest-VolumesTestJSON-1307248851 tempest-VolumesTestJSON-1307248851-project] Calling method '.version_select at 0x7f70de527c10>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:12:27.615343 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-62235120-9f86-4861-8ae9-5d3cc689d927 tempest-VolumesTestJSON-1307248851 tempest-VolumesTestJSON-1307248851-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/b10c8de1-0353-4c65-b427-566753fb8b54" status: 200 len: 350 microversion: 2.1 time: 0.052926 Jul 05 13:12:27.616022 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 573/1154] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Jul 5 13:12:27 2022] GET /compute/v2.1/os-volumes/b10c8de1-0353-4c65-b427-566753fb8b54 => generated 350 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:12:28.187773 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-89b3f4a8-175c-426b-894a-3f09b099928d tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:12:28.188387 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-89b3f4a8-175c-426b-894a-3f09b099928d tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] [instance: b83da4e1-8af3-4959-905a-6f3be7e2cf19] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:12:28.195388 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-89b3f4a8-175c-426b-894a-3f09b099928d tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:28.195839 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-89b3f4a8-175c-426b-894a-3f09b099928d tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:28.196616 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-89b3f4a8-175c-426b-894a-3f09b099928d tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:28.197054 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-89b3f4a8-175c-426b-894a-3f09b099928d tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:28.338086 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-89b3f4a8-175c-426b-894a-3f09b099928d tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8472b840794ab8ac0ccd49b2fd1657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0f29cb8f344bbf9fd1b7ffb626bbcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:12:28.346407 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-89b3f4a8-175c-426b-894a-3f09b099928d tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] 10.222.0.36 "GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19" status: 200 len: 1756 microversion: 2.1 time: 0.162471 Jul 05 13:12:28.347063 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 582/1155] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:12:28 2022] GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:12:29.236988 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-010034be-a158-4770-9999-a3873a337118 tempest-VolumesTestJSON-1307248851 tempest-VolumesTestJSON-1307248851-project] Calling method '.version_select at 0x7f70de76cf70>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:12:29.281385 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-010034be-a158-4770-9999-a3873a337118 tempest-VolumesTestJSON-1307248851 tempest-VolumesTestJSON-1307248851-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/d761a8e0-0c4c-4d32-a71e-555d633af494" status: 200 len: 350 microversion: 2.1 time: 0.048618 Jul 05 13:12:29.281942 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 574/1156] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Jul 5 13:12:29 2022] GET /compute/v2.1/os-volumes/d761a8e0-0c4c-4d32-a71e-555d633af494 => generated 350 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:12:29.367215 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-c99225f7-0d26-4216-88c3-1f2885640b2d tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:12:29.367830 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-c99225f7-0d26-4216-88c3-1f2885640b2d tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] [instance: b83da4e1-8af3-4959-905a-6f3be7e2cf19] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:12:29.375639 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c99225f7-0d26-4216-88c3-1f2885640b2d tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:29.376172 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c99225f7-0d26-4216-88c3-1f2885640b2d tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:29.377046 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c99225f7-0d26-4216-88c3-1f2885640b2d tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:29.377482 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c99225f7-0d26-4216-88c3-1f2885640b2d tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:29.518262 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-c99225f7-0d26-4216-88c3-1f2885640b2d tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8472b840794ab8ac0ccd49b2fd1657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0f29cb8f344bbf9fd1b7ffb626bbcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:12:29.526089 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-c99225f7-0d26-4216-88c3-1f2885640b2d tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] 10.222.0.36 "GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19" status: 200 len: 1756 microversion: 2.1 time: 0.162671 Jul 05 13:12:29.526642 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 583/1157] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:12:29 2022] GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:12:30.543863 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-47f8bb62-5d77-4111-a8a5-dc768ae0e4b9 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:12:30.544694 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-47f8bb62-5d77-4111-a8a5-dc768ae0e4b9 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] [instance: b83da4e1-8af3-4959-905a-6f3be7e2cf19] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:12:30.549247 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:12:30.554114 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-47f8bb62-5d77-4111-a8a5-dc768ae0e4b9 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:30.554561 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-47f8bb62-5d77-4111-a8a5-dc768ae0e4b9 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:30.555319 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-47f8bb62-5d77-4111-a8a5-dc768ae0e4b9 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:30.555813 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-47f8bb62-5d77-4111-a8a5-dc768ae0e4b9 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:30.702433 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-47f8bb62-5d77-4111-a8a5-dc768ae0e4b9 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8472b840794ab8ac0ccd49b2fd1657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0f29cb8f344bbf9fd1b7ffb626bbcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:12:30.710581 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-47f8bb62-5d77-4111-a8a5-dc768ae0e4b9 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] 10.222.0.36 "GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19" status: 200 len: 1756 microversion: 2.1 time: 0.171710 Jul 05 13:12:30.711133 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 575/1158] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:12:30 2022] GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19 => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:12:30.919970 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-c724fcd9-894d-4bfc-9718-94faa819ef17 tempest-VolumesTestJSON-1307248851 tempest-VolumesTestJSON-1307248851-project] Calling method '.version_select at 0x7f70de5d6ee0>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:12:30.966537 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-c724fcd9-894d-4bfc-9718-94faa819ef17 tempest-VolumesTestJSON-1307248851 tempest-VolumesTestJSON-1307248851-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/52a24c62-d29d-4c28-8ce6-c4e485da6588" status: 200 len: 351 microversion: 2.1 time: 0.050220 Jul 05 13:12:30.967092 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 584/1159] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Jul 5 13:12:30 2022] GET /compute/v2.1/os-volumes/52a24c62-d29d-4c28-8ce6-c4e485da6588 => generated 351 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:12:30.978022 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-10e24b90-0104-4d01-b0f5-4a39495730a3 tempest-VolumesTestJSON-1307248851 tempest-VolumesTestJSON-1307248851-project] Calling method '.version_select at 0x7f70de646820>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:12:31.056879 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-10e24b90-0104-4d01-b0f5-4a39495730a3 tempest-VolumesTestJSON-1307248851 tempest-VolumesTestJSON-1307248851-project] 10.222.0.36 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.082482 Jul 05 13:12:31.057440 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 576/1160] 10.222.0.36 () {58 vars in 1133 bytes} [Tue Jul 5 13:12:30 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:12:31.075729 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-74b4062f-d27b-42d7-8e73-afa3dda5d5c8 tempest-VolumesTestJSON-1307248851 tempest-VolumesTestJSON-1307248851-project] Calling method '.version_select at 0x7f70de787700>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:12:31.157226 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-74b4062f-d27b-42d7-8e73-afa3dda5d5c8 tempest-VolumesTestJSON-1307248851 tempest-VolumesTestJSON-1307248851-project] 10.222.0.36 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.085901 Jul 05 13:12:31.157803 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 585/1161] 10.222.0.36 () {58 vars in 1148 bytes} [Tue Jul 5 13:12:31 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:12:31.169794 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-d43ab51a-0388-4653-96b4-45167092479a tempest-VolumesTestJSON-1307248851 tempest-VolumesTestJSON-1307248851-project] Calling method '.version_select at 0x7f70de527670>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:12:31.248250 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-d43ab51a-0388-4653-96b4-45167092479a tempest-VolumesTestJSON-1307248851 tempest-VolumesTestJSON-1307248851-project] 10.222.0.36 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.082294 Jul 05 13:12:31.248847 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 577/1162] 10.222.0.36 () {58 vars in 1133 bytes} [Tue Jul 5 13:12:31 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:12:31.259877 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-db292cc7-6db6-4bcb-b97a-4cba19042346 tempest-VolumesTestJSON-1307248851 tempest-VolumesTestJSON-1307248851-project] Calling method '.version_select at 0x7f70de7ebc10>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:12:31.341427 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-db292cc7-6db6-4bcb-b97a-4cba19042346 tempest-VolumesTestJSON-1307248851 tempest-VolumesTestJSON-1307248851-project] 10.222.0.36 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.085251 Jul 05 13:12:31.341994 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 586/1163] 10.222.0.36 () {58 vars in 1166 bytes} [Tue Jul 5 13:12:31 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:12:31.353336 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-e7e9172a-62c7-4adf-828f-eef4fe7f3d0d tempest-VolumesTestJSON-1307248851 tempest-VolumesTestJSON-1307248851-project] Calling method '.version_select at 0x7f70de6dc8b0>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:12:31.431913 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-e7e9172a-62c7-4adf-828f-eef4fe7f3d0d tempest-VolumesTestJSON-1307248851 tempest-VolumesTestJSON-1307248851-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.082204 Jul 05 13:12:31.432499 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 578/1164] 10.222.0.36 () {58 vars in 1169 bytes} [Tue Jul 5 13:12:31 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:12:31.446088 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-26255628-c9c1-4fe6-8139-fab82a0dc0d6 tempest-VolumesTestJSON-1307248851 tempest-VolumesTestJSON-1307248851-project] Calling method '.version_select at 0x7f70e05081f0>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:12:31.525858 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-26255628-c9c1-4fe6-8139-fab82a0dc0d6 tempest-VolumesTestJSON-1307248851 tempest-VolumesTestJSON-1307248851-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.083418 Jul 05 13:12:31.526563 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 587/1165] 10.222.0.36 () {58 vars in 1154 bytes} [Tue Jul 5 13:12:31 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:12:31.537477 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-ab1f2407-e878-441c-b7af-ecc2523ee583 tempest-VolumesTestJSON-1307248851 tempest-VolumesTestJSON-1307248851-project] Calling method '.version_select at 0x7f70de6dc670>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:12:31.616422 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-ab1f2407-e878-441c-b7af-ecc2523ee583 tempest-VolumesTestJSON-1307248851 tempest-VolumesTestJSON-1307248851-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.082614 Jul 05 13:12:31.617070 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 579/1166] 10.222.0.36 () {58 vars in 1187 bytes} [Tue Jul 5 13:12:31 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:12:31.628824 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-dd8f1e33-5206-4238-95bd-741de1b0a660 tempest-VolumesTestJSON-1307248851 tempest-VolumesTestJSON-1307248851-project] Calling method '.version_select at 0x7f70de5d6e50>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:12:31.707805 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-dd8f1e33-5206-4238-95bd-741de1b0a660 tempest-VolumesTestJSON-1307248851 tempest-VolumesTestJSON-1307248851-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.082694 Jul 05 13:12:31.708373 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 588/1167] 10.222.0.36 () {58 vars in 1154 bytes} [Tue Jul 5 13:12:31 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:12:31.726961 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-4fd3fc5e-aa18-4b7d-946d-bfc4d418a651 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:12:31.727576 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-4fd3fc5e-aa18-4b7d-946d-bfc4d418a651 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] [instance: b83da4e1-8af3-4959-905a-6f3be7e2cf19] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:12:31.735005 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-4fd3fc5e-aa18-4b7d-946d-bfc4d418a651 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:31.735454 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-4fd3fc5e-aa18-4b7d-946d-bfc4d418a651 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:31.736215 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-4fd3fc5e-aa18-4b7d-946d-bfc4d418a651 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:31.736686 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-4fd3fc5e-aa18-4b7d-946d-bfc4d418a651 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:31.878947 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-4fd3fc5e-aa18-4b7d-946d-bfc4d418a651 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8472b840794ab8ac0ccd49b2fd1657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0f29cb8f344bbf9fd1b7ffb626bbcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:12:31.887946 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-4fd3fc5e-aa18-4b7d-946d-bfc4d418a651 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] 10.222.0.36 "GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19" status: 200 len: 1756 microversion: 2.1 time: 0.164802 Jul 05 13:12:31.888515 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 580/1168] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:12:31 2022] GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:12:32.905265 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-df34e6f1-be4d-4d1f-8226-f2026f1ae310 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:12:32.906032 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-df34e6f1-be4d-4d1f-8226-f2026f1ae310 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] [instance: b83da4e1-8af3-4959-905a-6f3be7e2cf19] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:12:32.912545 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-df34e6f1-be4d-4d1f-8226-f2026f1ae310 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:32.913017 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-df34e6f1-be4d-4d1f-8226-f2026f1ae310 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:32.913767 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-df34e6f1-be4d-4d1f-8226-f2026f1ae310 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:32.914197 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-df34e6f1-be4d-4d1f-8226-f2026f1ae310 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:33.056028 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-df34e6f1-be4d-4d1f-8226-f2026f1ae310 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8472b840794ab8ac0ccd49b2fd1657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0f29cb8f344bbf9fd1b7ffb626bbcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:12:33.065113 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-df34e6f1-be4d-4d1f-8226-f2026f1ae310 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] 10.222.0.36 "GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19" status: 200 len: 1756 microversion: 2.1 time: 0.164081 Jul 05 13:12:33.065685 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 589/1169] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:12:32 2022] GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:12:34.082063 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-0ed728b1-f735-42a3-a609-ae8abfe1a625 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:12:34.082671 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-0ed728b1-f735-42a3-a609-ae8abfe1a625 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] [instance: b83da4e1-8af3-4959-905a-6f3be7e2cf19] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:12:34.089209 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-0ed728b1-f735-42a3-a609-ae8abfe1a625 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:34.089649 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-0ed728b1-f735-42a3-a609-ae8abfe1a625 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:34.090399 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-0ed728b1-f735-42a3-a609-ae8abfe1a625 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:34.090827 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-0ed728b1-f735-42a3-a609-ae8abfe1a625 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:34.240003 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-0ed728b1-f735-42a3-a609-ae8abfe1a625 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8472b840794ab8ac0ccd49b2fd1657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0f29cb8f344bbf9fd1b7ffb626bbcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:12:34.248749 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-0ed728b1-f735-42a3-a609-ae8abfe1a625 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] 10.222.0.36 "GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19" status: 200 len: 1756 microversion: 2.1 time: 0.170537 Jul 05 13:12:34.249310 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 581/1170] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:12:34 2022] GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19 => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:12:35.266270 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-f2b6ab4a-80e6-4218-9690-fe52ae2437e8 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:12:35.266899 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-f2b6ab4a-80e6-4218-9690-fe52ae2437e8 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] [instance: b83da4e1-8af3-4959-905a-6f3be7e2cf19] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:12:35.273308 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f2b6ab4a-80e6-4218-9690-fe52ae2437e8 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:35.273756 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f2b6ab4a-80e6-4218-9690-fe52ae2437e8 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:35.274515 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f2b6ab4a-80e6-4218-9690-fe52ae2437e8 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:35.274950 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f2b6ab4a-80e6-4218-9690-fe52ae2437e8 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:35.424899 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-f2b6ab4a-80e6-4218-9690-fe52ae2437e8 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8472b840794ab8ac0ccd49b2fd1657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0f29cb8f344bbf9fd1b7ffb626bbcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:12:35.432921 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-f2b6ab4a-80e6-4218-9690-fe52ae2437e8 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] 10.222.0.36 "GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19" status: 200 len: 1756 microversion: 2.1 time: 0.170456 Jul 05 13:12:35.435571 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 590/1171] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:12:35 2022] GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19 => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:12:36.450405 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-3f831a8f-f413-41d6-9ac6-cc0de86af4d5 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:12:36.451201 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-3f831a8f-f413-41d6-9ac6-cc0de86af4d5 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] [instance: b83da4e1-8af3-4959-905a-6f3be7e2cf19] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:12:36.457649 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-3f831a8f-f413-41d6-9ac6-cc0de86af4d5 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:36.458086 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-3f831a8f-f413-41d6-9ac6-cc0de86af4d5 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:36.458860 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-3f831a8f-f413-41d6-9ac6-cc0de86af4d5 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:36.462886 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-3f831a8f-f413-41d6-9ac6-cc0de86af4d5 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:36.605797 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-3f831a8f-f413-41d6-9ac6-cc0de86af4d5 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8472b840794ab8ac0ccd49b2fd1657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0f29cb8f344bbf9fd1b7ffb626bbcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:12:36.613984 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-3f831a8f-f413-41d6-9ac6-cc0de86af4d5 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] 10.222.0.36 "GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19" status: 200 len: 1756 microversion: 2.1 time: 0.168283 Jul 05 13:12:36.614534 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 582/1172] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:12:36 2022] GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:12:37.631308 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-1476b3d1-36da-4174-b831-7b666a8553f7 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:12:37.631921 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-1476b3d1-36da-4174-b831-7b666a8553f7 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] [instance: b83da4e1-8af3-4959-905a-6f3be7e2cf19] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:12:37.639135 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1476b3d1-36da-4174-b831-7b666a8553f7 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:37.639583 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1476b3d1-36da-4174-b831-7b666a8553f7 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:37.651728 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1476b3d1-36da-4174-b831-7b666a8553f7 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:37.651728 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1476b3d1-36da-4174-b831-7b666a8553f7 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:37.784144 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-1476b3d1-36da-4174-b831-7b666a8553f7 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8472b840794ab8ac0ccd49b2fd1657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0f29cb8f344bbf9fd1b7ffb626bbcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:12:37.792202 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-1476b3d1-36da-4174-b831-7b666a8553f7 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] 10.222.0.36 "GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19" status: 200 len: 1756 microversion: 2.1 time: 0.164684 Jul 05 13:12:37.792803 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 591/1173] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:12:37 2022] GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:12:38.809471 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-85de1424-080d-489e-93e1-da740a80e28d tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:12:38.809977 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-85de1424-080d-489e-93e1-da740a80e28d tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] [instance: b83da4e1-8af3-4959-905a-6f3be7e2cf19] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:12:38.816221 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-85de1424-080d-489e-93e1-da740a80e28d tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:38.816696 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-85de1424-080d-489e-93e1-da740a80e28d tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:38.817462 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-85de1424-080d-489e-93e1-da740a80e28d tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:38.817926 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-85de1424-080d-489e-93e1-da740a80e28d tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:38.963354 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-85de1424-080d-489e-93e1-da740a80e28d tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8472b840794ab8ac0ccd49b2fd1657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0f29cb8f344bbf9fd1b7ffb626bbcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:12:38.971977 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-85de1424-080d-489e-93e1-da740a80e28d tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] 10.222.0.36 "GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19" status: 200 len: 1756 microversion: 2.1 time: 0.166524 Jul 05 13:12:38.972549 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 583/1174] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:12:38 2022] GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:12:39.988823 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-94389891-1cd6-4650-9d81-80fbc7cfc67b tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:12:39.989529 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-94389891-1cd6-4650-9d81-80fbc7cfc67b tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] [instance: b83da4e1-8af3-4959-905a-6f3be7e2cf19] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:12:40.003719 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-94389891-1cd6-4650-9d81-80fbc7cfc67b tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:40.003719 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-94389891-1cd6-4650-9d81-80fbc7cfc67b tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:40.003719 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-94389891-1cd6-4650-9d81-80fbc7cfc67b tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:40.003719 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-94389891-1cd6-4650-9d81-80fbc7cfc67b tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:40.158496 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-94389891-1cd6-4650-9d81-80fbc7cfc67b tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8472b840794ab8ac0ccd49b2fd1657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0f29cb8f344bbf9fd1b7ffb626bbcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:12:40.166390 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-94389891-1cd6-4650-9d81-80fbc7cfc67b tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] 10.222.0.36 "GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19" status: 200 len: 1756 microversion: 2.1 time: 0.181508 Jul 05 13:12:40.167014 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 592/1175] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:12:39 2022] GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19 => generated 1756 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:12:41.183036 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-4638173f-b86c-4781-aedc-f7b2717bceee tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:12:41.183650 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-4638173f-b86c-4781-aedc-f7b2717bceee tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] [instance: b83da4e1-8af3-4959-905a-6f3be7e2cf19] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:12:41.190737 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-4638173f-b86c-4781-aedc-f7b2717bceee tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:41.191618 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-4638173f-b86c-4781-aedc-f7b2717bceee tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:41.191928 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-4638173f-b86c-4781-aedc-f7b2717bceee tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:41.192366 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-4638173f-b86c-4781-aedc-f7b2717bceee tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:41.338996 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-4638173f-b86c-4781-aedc-f7b2717bceee tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8472b840794ab8ac0ccd49b2fd1657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0f29cb8f344bbf9fd1b7ffb626bbcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:12:41.347286 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-4638173f-b86c-4781-aedc-f7b2717bceee tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] 10.222.0.36 "GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19" status: 200 len: 1756 microversion: 2.1 time: 0.168012 Jul 05 13:12:41.347859 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 584/1176] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:12:41 2022] GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:12:42.365120 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-2b037c32-83db-4ce7-a3bd-3637bb64a824 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:12:42.365744 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-2b037c32-83db-4ce7-a3bd-3637bb64a824 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] [instance: b83da4e1-8af3-4959-905a-6f3be7e2cf19] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:12:42.372827 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2b037c32-83db-4ce7-a3bd-3637bb64a824 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:42.373277 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2b037c32-83db-4ce7-a3bd-3637bb64a824 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:42.374034 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2b037c32-83db-4ce7-a3bd-3637bb64a824 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:42.374465 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2b037c32-83db-4ce7-a3bd-3637bb64a824 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:42.529523 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-2b037c32-83db-4ce7-a3bd-3637bb64a824 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8472b840794ab8ac0ccd49b2fd1657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0f29cb8f344bbf9fd1b7ffb626bbcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:12:42.537426 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-2b037c32-83db-4ce7-a3bd-3637bb64a824 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] 10.222.0.36 "GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19" status: 200 len: 1756 microversion: 2.1 time: 0.176159 Jul 05 13:12:42.538007 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 593/1177] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:12:42 2022] GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19 => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:12:43.555028 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-e9ae9512-30a6-410c-a917-00cf6c8cf352 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:12:43.555626 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-e9ae9512-30a6-410c-a917-00cf6c8cf352 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] [instance: b83da4e1-8af3-4959-905a-6f3be7e2cf19] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:12:43.562060 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e9ae9512-30a6-410c-a917-00cf6c8cf352 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:43.562502 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e9ae9512-30a6-410c-a917-00cf6c8cf352 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:43.563326 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e9ae9512-30a6-410c-a917-00cf6c8cf352 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:43.563799 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-e9ae9512-30a6-410c-a917-00cf6c8cf352 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:43.708911 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-e9ae9512-30a6-410c-a917-00cf6c8cf352 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8472b840794ab8ac0ccd49b2fd1657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0f29cb8f344bbf9fd1b7ffb626bbcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:12:43.717070 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-e9ae9512-30a6-410c-a917-00cf6c8cf352 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] 10.222.0.36 "GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19" status: 200 len: 1756 microversion: 2.1 time: 0.165844 Jul 05 13:12:43.722992 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 585/1178] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:12:43 2022] GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:12:44.738483 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-6eaeeac0-c859-4ec3-9537-95f6e1632d11 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:12:44.739095 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-6eaeeac0-c859-4ec3-9537-95f6e1632d11 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] [instance: b83da4e1-8af3-4959-905a-6f3be7e2cf19] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:12:44.745430 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6eaeeac0-c859-4ec3-9537-95f6e1632d11 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:44.745888 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6eaeeac0-c859-4ec3-9537-95f6e1632d11 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:44.746672 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6eaeeac0-c859-4ec3-9537-95f6e1632d11 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:12:44.747178 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6eaeeac0-c859-4ec3-9537-95f6e1632d11 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:12:44.751053 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell1:SELECT=74 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:12:44.890742 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-6eaeeac0-c859-4ec3-9537-95f6e1632d11 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8472b840794ab8ac0ccd49b2fd1657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0f29cb8f344bbf9fd1b7ffb626bbcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:12:44.898698 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-6eaeeac0-c859-4ec3-9537-95f6e1632d11 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] 10.222.0.36 "GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19" status: 200 len: 1759 microversion: 2.1 time: 0.163927 Jul 05 13:12:44.899667 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 594/1179] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:12:44 2022] GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19 => generated 1759 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 13:13:23.740897 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-f271cb46-b3c8-4123-9c84-415fd9f05ca7 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-770780059"}} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:13:23.741491 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-f271cb46-b3c8-4123-9c84-415fd9f05ca7 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] [instance: b83da4e1-8af3-4959-905a-6f3be7e2cf19] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:13:23.743513 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_api:SELECT=13 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:13:23.744170 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG dbcounter [-] [118386] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:13:23.748856 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f271cb46-b3c8-4123-9c84-415fd9f05ca7 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:13:23.749295 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f271cb46-b3c8-4123-9c84-415fd9f05ca7 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:13:23.750149 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f271cb46-b3c8-4123-9c84-415fd9f05ca7 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:13:23.750585 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f271cb46-b3c8-4123-9c84-415fd9f05ca7 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:13:23.874515 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.network.security_group_api [None req-f271cb46-b3c8-4123-9c84-415fd9f05ca7 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Removing security group 1a7eaa52-97d0-496d-94e7-3cb0fd8c4d43 from port 6058ab7a-1269-4b24-bfb7-6b0f5686441f Jul 05 13:13:24.535293 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-f271cb46-b3c8-4123-9c84-415fd9f05ca7 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] 10.222.0.36 "POST /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19/action" status: 202 len: 0 microversion: 2.1 time: 0.793335 Jul 05 13:13:24.536785 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 586/1180] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Jul 5 13:13:23 2022] POST /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19/action => generated 0 bytes in 800 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 13:13:24.549353 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_api:SELECT=17 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:13:24.551193 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell1:SELECT=5 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:13:24.728461 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-8ffd75af-16e5-4d14-b8f7-7e1a8a020a61 req-61e6a57d-c806-4d76-8484-f175a5f0944a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b83da4e1-8af3-4959-905a-6f3be7e2cf19", "tag": "6058ab7a-1269-4b24-bfb7-6b0f5686441f"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:13:24.738948 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-8ffd75af-16e5-4d14-b8f7-7e1a8a020a61 req-61e6a57d-c806-4d76-8484-f175a5f0944a service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:13:24.739647 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-8ffd75af-16e5-4d14-b8f7-7e1a8a020a61 req-61e6a57d-c806-4d76-8484-f175a5f0944a service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:13:24.754289 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-8ffd75af-16e5-4d14-b8f7-7e1a8a020a61 req-61e6a57d-c806-4d76-8484-f175a5f0944a service nova] Creating event network-changed:6058ab7a-1269-4b24-bfb7-6b0f5686441f for instance b83da4e1-8af3-4959-905a-6f3be7e2cf19 on hv-cinder-79760 Jul 05 13:13:24.761623 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-8ffd75af-16e5-4d14-b8f7-7e1a8a020a61 req-61e6a57d-c806-4d76-8484-f175a5f0944a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.227448 Jul 05 13:13:24.764757 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 595/1181] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:13:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:13:25.794451 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-6114fe55-992f-45e7-85d3-d5cf53ea729a tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:13:25.795007 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-6114fe55-992f-45e7-85d3-d5cf53ea729a tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] [instance: b83da4e1-8af3-4959-905a-6f3be7e2cf19] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:13:25.801097 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-6114fe55-992f-45e7-85d3-d5cf53ea729a tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:13:25.801610 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-6114fe55-992f-45e7-85d3-d5cf53ea729a tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:13:25.802458 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-6114fe55-992f-45e7-85d3-d5cf53ea729a tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:13:25.802967 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-6114fe55-992f-45e7-85d3-d5cf53ea729a tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:13:25.889179 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.objects.instance [None req-6114fe55-992f-45e7-85d3-d5cf53ea729a tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lazy-loading 'services' on Instance uuid b83da4e1-8af3-4959-905a-6f3be7e2cf19 {{(pid=118386) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 13:13:26.131434 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-6114fe55-992f-45e7-85d3-d5cf53ea729a tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19/os-volume_attachments/9aec6286-2e92-43a7-8b70-df577b068855" status: 202 len: 0 microversion: 2.1 time: 0.329405 Jul 05 13:13:26.131434 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 587/1182] 10.222.0.36 () {58 vars in 1415 bytes} [Tue Jul 5 13:13:25 2022] DELETE /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19/os-volume_attachments/9aec6286-2e92-43a7-8b70-df577b068855 => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 13:13:26.135591 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-aa9fcf06-7c87-4b68-8388-8d45bd9fd714 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:13:26.143298 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-aa9fcf06-7c87-4b68-8388-8d45bd9fd714 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] [instance: b83da4e1-8af3-4959-905a-6f3be7e2cf19] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:13:26.155036 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-aa9fcf06-7c87-4b68-8388-8d45bd9fd714 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:13:26.155643 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-aa9fcf06-7c87-4b68-8388-8d45bd9fd714 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:13:26.156558 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-aa9fcf06-7c87-4b68-8388-8d45bd9fd714 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:13:26.157239 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-aa9fcf06-7c87-4b68-8388-8d45bd9fd714 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:13:26.191892 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-aa9fcf06-7c87-4b68-8388-8d45bd9fd714 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] 10.222.0.36 "GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066436 Jul 05 13:13:26.192458 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 596/1183] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jul 5 13:13:26 2022] GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:13:26.777419 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [req-adf7336b-a1bf-4aa3-a257-7140c0de1f2a req-557c308b-74d5-4db0-a40b-7efe67bbc6b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b83da4e1-8af3-4959-905a-6f3be7e2cf19", "tag": "6058ab7a-1269-4b24-bfb7-6b0f5686441f"}]} {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:13:26.786501 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-adf7336b-a1bf-4aa3-a257-7140c0de1f2a req-557c308b-74d5-4db0-a40b-7efe67bbc6b8 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:13:26.786937 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [req-adf7336b-a1bf-4aa3-a257-7140c0de1f2a req-557c308b-74d5-4db0-a40b-7efe67bbc6b8 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:13:26.799115 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.compute.server_external_events [req-adf7336b-a1bf-4aa3-a257-7140c0de1f2a req-557c308b-74d5-4db0-a40b-7efe67bbc6b8 service nova] Creating event network-changed:6058ab7a-1269-4b24-bfb7-6b0f5686441f for instance b83da4e1-8af3-4959-905a-6f3be7e2cf19 on hv-cinder-79760 Jul 05 13:13:26.806793 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [req-adf7336b-a1bf-4aa3-a257-7140c0de1f2a req-557c308b-74d5-4db0-a40b-7efe67bbc6b8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032335 Jul 05 13:13:26.807408 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 588/1184] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:13:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:13:27.212043 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-414593e7-16c6-43f4-b305-e1d2cf9d6246 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:13:27.213862 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-414593e7-16c6-43f4-b305-e1d2cf9d6246 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] [instance: b83da4e1-8af3-4959-905a-6f3be7e2cf19] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:13:27.221895 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-414593e7-16c6-43f4-b305-e1d2cf9d6246 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:13:27.223052 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-414593e7-16c6-43f4-b305-e1d2cf9d6246 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:13:27.223971 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-414593e7-16c6-43f4-b305-e1d2cf9d6246 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:13:27.224470 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-414593e7-16c6-43f4-b305-e1d2cf9d6246 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:13:27.254306 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-414593e7-16c6-43f4-b305-e1d2cf9d6246 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] 10.222.0.36 "GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048376 Jul 05 13:13:27.255280 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 597/1185] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jul 5 13:13:27 2022] GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 05 13:13:27.265791 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-4b97b831-dfaf-4074-a07b-58120a017179 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:13:27.266374 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-4b97b831-dfaf-4074-a07b-58120a017179 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] [instance: b83da4e1-8af3-4959-905a-6f3be7e2cf19] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:13:27.273425 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-4b97b831-dfaf-4074-a07b-58120a017179 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:13:27.274098 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-4b97b831-dfaf-4074-a07b-58120a017179 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:13:27.275087 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-4b97b831-dfaf-4074-a07b-58120a017179 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:13:27.275774 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-4b97b831-dfaf-4074-a07b-58120a017179 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:13:27.353455 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.wsgi [None req-4b97b831-dfaf-4074-a07b-58120a017179 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] HTTP exception thrown: Instance b83da4e1-8af3-4959-905a-6f3be7e2cf19 is not attached to volume 9aec6286-2e92-43a7-8b70-df577b068855 Jul 05 13:13:27.355833 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-4b97b831-dfaf-4074-a07b-58120a017179 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Request method failure captured: Jul 05 13:13:27.355833 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: request: DELETE /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19/os-volume_attachments/9aec6286-2e92-43a7-8b70-df577b068855 HTTP/1.1 Jul 05 13:13:27.355833 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Accept: application/json Jul 05 13:13:27.355833 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Accept-Encoding: identity Jul 05 13:13:27.355833 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Connection: close Jul 05 13:13:27.355833 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Content-Length: 0 Jul 05 13:13:27.355833 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Content-Type: application/json Jul 05 13:13:27.355833 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Host: 10.222.0.36 Jul 05 13:13:27.355833 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Openstack-System-Scope: None Jul 05 13:13:27.355833 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: User-Agent: python-urllib3/1.26.9 Jul 05 13:13:27.355833 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Auth-Token: gAAAAABixDhrI2Ke001ogdt696K67FWCV5gKxts1zUx2Goz5aiOEgaMiB3TLIgEHAeign9h_dovd0RoAEun5P8VGeiLhXESaqJbsMnMl65OzauPp14ga_KKV4im17lw6PGCUlV8ei4dadYfUXACjkmmLCcvczI5bR7AF1Yc8naTYnk_FRynES28 Jul 05 13:13:27.355833 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Domain-Id: None Jul 05 13:13:27.355833 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Domain-Name: None Jul 05 13:13:27.355833 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Identity-Status: Confirmed Jul 05 13:13:27.355833 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Is-Admin-Project: True Jul 05 13:13:27.355833 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Domain-Id: default Jul 05 13:13:27.355833 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Domain-Name: Default Jul 05 13:13:27.355833 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Id: 4e0f29cb8f344bbf9fd1b7ffb626bbcb Jul 05 13:13:27.355833 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Project-Name: tempest-TestMinimumBasicScenario-1489903764 Jul 05 13:13:27.355833 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Role: member,reader Jul 05 13:13:27.355833 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Roles: member,reader Jul 05 13:13:27.357955 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4e0f29cb8f344bbf9fd1b7ffb626bbcb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4e0f29cb8f344bbf9fd1b7ffb626bbcb", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4e0f29cb8f344bbf9fd1b7ffb626bbcb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4e0f29cb8f344bbf9fd1b7ffb626bbcb"}]}] Jul 05 13:13:27.357955 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Tenant: tempest-TestMinimumBasicScenario-1489903764 Jul 05 13:13:27.357955 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Tenant-Id: 4e0f29cb8f344bbf9fd1b7ffb626bbcb Jul 05 13:13:27.357955 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1489903764 Jul 05 13:13:27.357955 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User: tempest-TestMinimumBasicScenario-1489903764-project Jul 05 13:13:27.357955 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Domain-Id: default Jul 05 13:13:27.357955 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Domain-Name: Default Jul 05 13:13:27.357955 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Id: dc8472b840794ab8ac0ccd49b2fd1657 Jul 05 13:13:27.357955 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: X-User-Name: tempest-TestMinimumBasicScenario-1489903764-project Jul 05 13:13:27.357955 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: method: > Jul 05 13:13:27.357955 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: exception: Instance b83da4e1-8af3-4959-905a-6f3be7e2cf19 is not attached to volume 9aec6286-2e92-43a7-8b70-df577b068855 Jul 05 13:13:27.359072 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: action_args: {'server_id': 'b83da4e1-8af3-4959-905a-6f3be7e2cf19', 'id': '9aec6286-2e92-43a7-8b70-df577b068855'} Jul 05 13:13:27.359072 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 13:13:27.359072 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:13:27.359072 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 05 13:13:27.359072 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 05 13:13:27.359072 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 05 13:13:27.359072 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 05 13:13:27.359072 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 05 13:13:27.359072 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 05 13:13:27.359072 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 9aec6286-2e92-43a7-8b70-df577b068855. Jul 05 13:13:27.359072 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:13:27.359072 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:13:27.359072 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:13:27.359072 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:13:27.359072 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:13:27.359072 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:13:27.359072 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 13:13:27.359072 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 13:13:27.359072 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 13:13:27.360728 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 13:13:27.360728 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 05 13:13:27.360728 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 05 13:13:27.360728 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b83da4e1-8af3-4959-905a-6f3be7e2cf19 is not attached to volume 9aec6286-2e92-43a7-8b70-df577b068855 Jul 05 13:13:27.360728 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:13:27.360728 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:13:27.360728 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:13:27.360728 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:13:27.360728 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:13:27.360728 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:13:27.360728 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 13:13:27.360728 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 13:13:27.360728 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b83da4e1-8af3-4959-905a-6f3be7e2cf19 is not attached to volume 9aec6286-2e92-43a7-8b70-df577b068855 Jul 05 13:13:27.360728 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: ERROR nova.api.openstack.wsgi Jul 05 13:13:27.360728 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-4b97b831-dfaf-4074-a07b-58120a017179 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Returning 404 to user: Instance b83da4e1-8af3-4959-905a-6f3be7e2cf19 is not attached to volume 9aec6286-2e92-43a7-8b70-df577b068855 {{(pid=118386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 13:13:27.362208 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-4b97b831-dfaf-4074-a07b-58120a017179 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19/os-volume_attachments/9aec6286-2e92-43a7-8b70-df577b068855" status: 404 len: 154 microversion: 2.1 time: 0.096314 Jul 05 13:13:27.362208 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 589/1186] 10.222.0.36 () {58 vars in 1415 bytes} [Tue Jul 5 13:13:27 2022] DELETE /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19/os-volume_attachments/9aec6286-2e92-43a7-8b70-df577b068855 => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 13:13:28.651539 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-47011b37-00a2-47c0-ab2e-75b1d2ead367 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:13:28.652038 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-47011b37-00a2-47c0-ab2e-75b1d2ead367 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] [instance: b83da4e1-8af3-4959-905a-6f3be7e2cf19] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:13:28.658294 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-47011b37-00a2-47c0-ab2e-75b1d2ead367 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:13:28.658680 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-47011b37-00a2-47c0-ab2e-75b1d2ead367 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:13:28.659431 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-47011b37-00a2-47c0-ab2e-75b1d2ead367 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:13:28.660483 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-47011b37-00a2-47c0-ab2e-75b1d2ead367 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:13:28.684435 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-47011b37-00a2-47c0-ab2e-75b1d2ead367 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] [instance: b83da4e1-8af3-4959-905a-6f3be7e2cf19] Going to try to terminate instance {{(pid=118387) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 13:13:28.977148 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-47011b37-00a2-47c0-ab2e-75b1d2ead367 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19" status: 204 len: 0 microversion: 2.1 time: 0.329136 Jul 05 13:13:28.978183 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 598/1187] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jul 5 13:13:28 2022] DELETE /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 05 13:13:28.988947 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-61923554-bfe5-48d6-bc4b-c3b19ff79ec7 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:13:28.989668 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-61923554-bfe5-48d6-bc4b-c3b19ff79ec7 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] [instance: b83da4e1-8af3-4959-905a-6f3be7e2cf19] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:13:28.995978 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-61923554-bfe5-48d6-bc4b-c3b19ff79ec7 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:13:28.996426 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-61923554-bfe5-48d6-bc4b-c3b19ff79ec7 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:13:28.997208 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-61923554-bfe5-48d6-bc4b-c3b19ff79ec7 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:13:28.997643 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-61923554-bfe5-48d6-bc4b-c3b19ff79ec7 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:13:29.171551 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-61923554-bfe5-48d6-bc4b-c3b19ff79ec7 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8472b840794ab8ac0ccd49b2fd1657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0f29cb8f344bbf9fd1b7ffb626bbcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:13:29.179194 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-61923554-bfe5-48d6-bc4b-c3b19ff79ec7 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] 10.222.0.36 "GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19" status: 200 len: 1554 microversion: 2.1 time: 0.194085 Jul 05 13:13:29.179751 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 590/1188] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:13:28 2022] GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19 => generated 1554 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:13:30.196883 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-c43251a2-957f-4b28-842a-4fffd66656a4 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:13:30.197517 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-c43251a2-957f-4b28-842a-4fffd66656a4 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] [instance: b83da4e1-8af3-4959-905a-6f3be7e2cf19] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:13:30.203922 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c43251a2-957f-4b28-842a-4fffd66656a4 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:13:30.204375 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c43251a2-957f-4b28-842a-4fffd66656a4 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:13:30.205165 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c43251a2-957f-4b28-842a-4fffd66656a4 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:13:30.205601 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c43251a2-957f-4b28-842a-4fffd66656a4 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:13:30.333740 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-c43251a2-957f-4b28-842a-4fffd66656a4 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8472b840794ab8ac0ccd49b2fd1657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0f29cb8f344bbf9fd1b7ffb626bbcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:13:30.341204 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-c43251a2-957f-4b28-842a-4fffd66656a4 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] 10.222.0.36 "GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19" status: 200 len: 1554 microversion: 2.1 time: 0.148669 Jul 05 13:13:30.341768 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 599/1189] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:13:30 2022] GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19 => generated 1554 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:13:31.359195 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-f3fe470d-0771-4445-9152-1644a075a53b tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Calling method '>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:13:31.359902 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.compute.api [None req-f3fe470d-0771-4445-9152-1644a075a53b tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] [instance: b83da4e1-8af3-4959-905a-6f3be7e2cf19] Fetching instance by UUID {{(pid=118386) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:13:31.367346 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f3fe470d-0771-4445-9152-1644a075a53b tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:13:31.367879 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f3fe470d-0771-4445-9152-1644a075a53b tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:13:31.368774 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f3fe470d-0771-4445-9152-1644a075a53b tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:13:31.369191 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-8d2d4fbc-ec40-4559-828a-eff5093d83ff req-02c75dde-5b61-4521-a469-c2df21827ff7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b83da4e1-8af3-4959-905a-6f3be7e2cf19", "name": "network-vif-deleted", "tag": "6058ab7a-1269-4b24-bfb7-6b0f5686441f"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 13:13:31.369686 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG oslo_concurrency.lockutils [None req-f3fe470d-0771-4445-9152-1644a075a53b tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:13:31.377624 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-8d2d4fbc-ec40-4559-828a-eff5093d83ff req-02c75dde-5b61-4521-a469-c2df21827ff7 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:13:31.381178 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-8d2d4fbc-ec40-4559-828a-eff5093d83ff req-02c75dde-5b61-4521-a469-c2df21827ff7 service nova] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:13:31.388874 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-8d2d4fbc-ec40-4559-828a-eff5093d83ff req-02c75dde-5b61-4521-a469-c2df21827ff7 service nova] Creating event network-vif-deleted:6058ab7a-1269-4b24-bfb7-6b0f5686441f for instance b83da4e1-8af3-4959-905a-6f3be7e2cf19 on hv-cinder-79760 Jul 05 13:13:31.393676 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-8d2d4fbc-ec40-4559-828a-eff5093d83ff req-02c75dde-5b61-4521-a469-c2df21827ff7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028676 Jul 05 13:13:31.394267 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 600/1190] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jul 5 13:13:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 13:13:31.431999 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.policy [None req-f3fe470d-0771-4445-9152-1644a075a53b tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8472b840794ab8ac0ccd49b2fd1657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0f29cb8f344bbf9fd1b7ffb626bbcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118386) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 13:13:31.439766 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-f3fe470d-0771-4445-9152-1644a075a53b tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] 10.222.0.36 "GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19" status: 200 len: 1512 microversion: 2.1 time: 0.084919 Jul 05 13:13:31.440333 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 591/1191] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:13:31 2022] GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19 => generated 1512 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 13:13:32.457724 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-47a47058-146c-4d02-8075-4fe4775456f3 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:13:32.458433 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-47a47058-146c-4d02-8075-4fe4775456f3 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] [instance: b83da4e1-8af3-4959-905a-6f3be7e2cf19] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 13:13:32.464820 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-47a47058-146c-4d02-8075-4fe4775456f3 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:13:32.465275 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-47a47058-146c-4d02-8075-4fe4775456f3 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:13:32.466046 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-47a47058-146c-4d02-8075-4fe4775456f3 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 13:13:32.466486 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-47a47058-146c-4d02-8075-4fe4775456f3 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Lock "1f103960-fac2-43f5-a4e1-1a426049bf0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 13:13:32.481228 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.wsgi [None req-47a47058-146c-4d02-8075-4fe4775456f3 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] HTTP exception thrown: Instance b83da4e1-8af3-4959-905a-6f3be7e2cf19 could not be found. Jul 05 13:13:32.483126 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-47a47058-146c-4d02-8075-4fe4775456f3 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Request method failure captured: Jul 05 13:13:32.483126 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: request: GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19 HTTP/1.1 Jul 05 13:13:32.483126 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept: application/json Jul 05 13:13:32.483126 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Accept-Encoding: identity Jul 05 13:13:32.483126 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Connection: close Jul 05 13:13:32.483126 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Length: 0 Jul 05 13:13:32.483126 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Content-Type: application/json Jul 05 13:13:32.483126 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Host: 10.222.0.36 Jul 05 13:13:32.483126 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Openstack-System-Scope: None Jul 05 13:13:32.483126 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: User-Agent: python-urllib3/1.26.9 Jul 05 13:13:32.483126 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Auth-Token: gAAAAABixDhrI2Ke001ogdt696K67FWCV5gKxts1zUx2Goz5aiOEgaMiB3TLIgEHAeign9h_dovd0RoAEun5P8VGeiLhXESaqJbsMnMl65OzauPp14ga_KKV4im17lw6PGCUlV8ei4dadYfUXACjkmmLCcvczI5bR7AF1Yc8naTYnk_FRynES28 Jul 05 13:13:32.483126 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Id: None Jul 05 13:13:32.483126 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Domain-Name: None Jul 05 13:13:32.483126 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Identity-Status: Confirmed Jul 05 13:13:32.483126 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Is-Admin-Project: True Jul 05 13:13:32.483126 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Id: default Jul 05 13:13:32.483126 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Domain-Name: Default Jul 05 13:13:32.483126 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Id: 4e0f29cb8f344bbf9fd1b7ffb626bbcb Jul 05 13:13:32.483126 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Project-Name: tempest-TestMinimumBasicScenario-1489903764 Jul 05 13:13:32.483126 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Role: member,reader Jul 05 13:13:32.483126 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Roles: member,reader Jul 05 13:13:32.486658 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4e0f29cb8f344bbf9fd1b7ffb626bbcb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4e0f29cb8f344bbf9fd1b7ffb626bbcb", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4e0f29cb8f344bbf9fd1b7ffb626bbcb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4e0f29cb8f344bbf9fd1b7ffb626bbcb"}]}] Jul 05 13:13:32.486658 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant: tempest-TestMinimumBasicScenario-1489903764 Jul 05 13:13:32.486658 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Id: 4e0f29cb8f344bbf9fd1b7ffb626bbcb Jul 05 13:13:32.486658 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1489903764 Jul 05 13:13:32.486658 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User: tempest-TestMinimumBasicScenario-1489903764-project Jul 05 13:13:32.486658 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Id: default Jul 05 13:13:32.486658 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Domain-Name: Default Jul 05 13:13:32.486658 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Id: dc8472b840794ab8ac0ccd49b2fd1657 Jul 05 13:13:32.486658 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: X-User-Name: tempest-TestMinimumBasicScenario-1489903764-project Jul 05 13:13:32.486658 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: method: > Jul 05 13:13:32.486658 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: exception: Instance b83da4e1-8af3-4959-905a-6f3be7e2cf19 could not be found. Jul 05 13:13:32.486658 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: action_args: {'id': 'b83da4e1-8af3-4959-905a-6f3be7e2cf19'} Jul 05 13:13:32.487647 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 13:13:32.487647 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:13:32.487647 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 13:13:32.487647 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 13:13:32.487647 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 13:13:32.487647 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 13:13:32.487647 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 13:13:32.487647 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 13:13:32.487647 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 13:13:32.487647 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 13:13:32.487647 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b83da4e1-8af3-4959-905a-6f3be7e2cf19 could not be found. Jul 05 13:13:32.487647 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:13:32.487647 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:13:32.487647 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:13:32.487647 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:13:32.487647 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:13:32.487647 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:13:32.487647 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 13:13:32.487647 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 13:13:32.487647 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 13:13:32.489283 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 13:13:32.489283 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 13:13:32.489283 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 13:13:32.489283 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 13:13:32.489283 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 13:13:32.489283 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 13:13:32.489283 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 13:13:32.489283 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b83da4e1-8af3-4959-905a-6f3be7e2cf19 could not be found. Jul 05 13:13:32.489283 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:13:32.489283 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 13:13:32.489283 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:13:32.489283 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 13:13:32.489283 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 13:13:32.489283 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 13:13:32.489283 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 13:13:32.489283 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 13:13:32.489283 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b83da4e1-8af3-4959-905a-6f3be7e2cf19 could not be found. Jul 05 13:13:32.489283 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 05 13:13:32.491317 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-47a47058-146c-4d02-8075-4fe4775456f3 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Returning 404 to user: Instance b83da4e1-8af3-4959-905a-6f3be7e2cf19 could not be found. {{(pid=118387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 13:13:32.491317 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-47a47058-146c-4d02-8075-4fe4775456f3 tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] 10.222.0.36 "GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19" status: 404 len: 111 microversion: 2.1 time: 0.031657 Jul 05 13:13:32.491317 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 601/1192] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jul 5 13:13:32 2022] GET /compute/v2.1/servers/b83da4e1-8af3-4959-905a-6f3be7e2cf19 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 13:13:32.494011 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: DEBUG nova.api.openstack.wsgi [None req-8a7ec54d-3bf0-4e90-bf56-11240696326c tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] Calling method '.version_select at 0x7f70de76cdc0>' {{(pid=118386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 13:13:32.601852 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO nova.api.openstack.requestlog [None req-8a7ec54d-3bf0-4e90-bf56-11240696326c tempest-TestMinimumBasicScenario-1489903764 tempest-TestMinimumBasicScenario-1489903764-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-968582176" status: 202 len: 0 microversion: 2.1 time: 0.112132 Jul 05 13:13:32.602439 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: [pid: 118386|app: 0|req: 592/1193] 10.222.0.36 () {58 vars in 1268 bytes} [Tue Jul 5 13:13:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-968582176 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 13:13:48.000407 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 05 13:13:48.000990 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Tue Jul 5 13:13:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 05 13:16:09.613182 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Jul 05 13:16:11.670000 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 05 13:16:11.673769 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Tue Jul 5 13:16:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 05 13:16:15.546404 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 05 13:16:15.546970 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Tue Jul 5 13:16:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 05 13:16:33.718490 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 05 13:16:33.719164 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Tue Jul 5 13:16:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 05 13:16:35.244365 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 05 13:16:35.245029 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Tue Jul 5 13:16:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 05 13:18:39.617058 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Jul 05 13:18:39.617682 dv-cinder-797608-48-iscsi devstack@n-api.service[118386]: Tue Jul 5 13:18:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 05 13:18:48.008813 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 05 13:18:48.009350 dv-cinder-797608-48-iscsi devstack@n-api.service[118387]: Tue Jul 5 13:18:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!